-- Logs begin at Mon 2022-01-10 10:39:38 UTC, end at Mon 2022-01-10 11:59:25 UTC. -- Jan 10 11:15:15.771369 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 10 11:15:15.780155 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 11:15:15 2022] *** Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: nodename: dv-cinder-master-3-iscsi Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: machine: x86_64 Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: clock source: unix Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: pcre jit disabled Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: detected number of CPU cores: 4 Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: current working directory: / Jan 10 11:15:15.782093 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: detected binary path: /usr/bin/uwsgi-core Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: your processes number limit is 47680 Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: your memory page size is 4096 bytes Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: detected max file descriptor number: 2048 Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: lock engine: pthread robust mutexes Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: thunder lock: enabled Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 10 11:15:15.782894 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 11:15:15.833755 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: Python main interpreter initialized at 0x55a59543e9c0 Jan 10 11:15:15.833755 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: python threads support enabled Jan 10 11:15:15.833755 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: your server socket listen backlog is limited to 100 connections Jan 10 11:15:15.833755 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: your mercy for graceful operations on workers is 90 seconds Jan 10 11:15:15.834143 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 11:15:15.834260 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: *** Operational MODE: preforking *** Jan 10 11:15:15.834469 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: *** uWSGI is running in multiple interpreter mode *** Jan 10 11:15:15.834469 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: spawned uWSGI master process (pid: 79412) Jan 10 11:15:15.834676 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 10 11:15:15.836274 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: spawned uWSGI worker 1 (pid: 79425, cores: 1) Jan 10 11:15:15.836274 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: spawned uWSGI worker 2 (pid: 79426, cores: 1) Jan 10 11:15:15.836274 dv-cinder-master-3-iscsi devstack@keystone.service[79412]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 11:15:21.305139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:15:21.305139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: from cryptography.utils import int_from_bytes Jan 10 11:15:21.305951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:15:21.305951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: from cryptography.utils import int_from_bytes Jan 10 11:15:21.310874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:15:21.310874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: from cryptography.utils import int_from_bytes Jan 10 11:15:21.311318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:15:21.311318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: from cryptography.utils import int_from_bytes Jan 10 11:15:21.352186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 11:15:21.352383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 11:15:21.352573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] command line args: [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 11:15:21.352843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 11:15:21.353021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ================================================================================ {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 11:15:21.353275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] admin_token = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.353524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] config_dir = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.353713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.353936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] config_source = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.354117 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] debug = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.354355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.354774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.354944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.355199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.355450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.355684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.355796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 11:15:21.355881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_config_append = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.356000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 11:15:21.356113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.356216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] command line args: [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 11:15:21.356327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_dir = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.356428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_file = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.356538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 11:15:21.356651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.356771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ================================================================================ {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 11:15:21.356891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] admin_token = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] config_dir = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] config_source = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] debug = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.357935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.358907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_config_append = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_dir = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.359943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_file = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] publish_errors = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.360960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.361927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] standard_threads = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.362896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] use_journal = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] use_json = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] use_stderr = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] use_syslog = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.363754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.363953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.364062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.364160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] publish_errors = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.364278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.364398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.364513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.364626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.364626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.364923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.364923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.365136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.365251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.365372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.365488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.365608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] standard_threads = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.365608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.365828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.365950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.366072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.366194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.366345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.366468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] use_journal = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.366589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.366746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] use_json = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.366746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] use_stderr = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.366980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.367101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] use_syslog = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.367216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.367337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:15:21.367452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.367573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.367695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.367817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.367937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.368885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.369019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.369143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.369270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.369386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.370897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.371944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.372993 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.373924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.374892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.375960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.376909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.377946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.378943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379542 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.379904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.380951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.381998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.382956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.383906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.384927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.385043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.385043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.385834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.385957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.external = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.386817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387480 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.password = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.387951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] auth.token = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.388990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.389918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.390041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.390156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.390284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.390401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.390514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.390874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.391939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.external = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.392913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.password = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] auth.token = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.393955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.394945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.395887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396117 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.396947 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.397888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.398950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.399998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.400916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.401875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.402953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.403881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.404944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.405974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.406963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.407909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408492 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.408957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.409888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.410955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.411895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.412934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.413983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.414941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.415904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.416896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.417940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.418927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] role.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] role.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.419981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420209 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.420907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.421902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422381 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422626 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.422972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.423966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424673 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.424905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.425946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] role.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] role.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.426945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427745 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.427974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.428908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.429939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.430904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.431841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.432621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.connection = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.432747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.432873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.432991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.433891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.434948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.435957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 11:15:21.436771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.436771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.437197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.437197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.437410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.437606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.437843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.438093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.438398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.438659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.connection = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.438907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.439163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.439404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.439649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.439889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.440128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.440367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.440607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.440885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.441126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.441489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.441733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.441992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.442252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.442509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.442746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.442991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.443230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:15:21.443402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 11:15:21.467131 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.467370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.467601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.471207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.471446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.471675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.476192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.480864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.506986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.507220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.509006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.509248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.563211 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.563514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.612699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.612934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.615278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.615519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.680394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.680614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.680840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.681059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.681275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.681490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.683428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.683665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.683892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.684116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.684338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.684555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.706693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.706924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.707958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.708036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.708112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.708214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.719424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.720250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.732645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.732875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.733924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.734020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.734147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.734398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.734616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.734831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 11:15:21.752204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.752413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 11:15:21.752750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.752961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.753047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 11:15:21.753176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 11:15:21.753262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.753474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.753556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.753701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 11:15:21.753792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.753972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.754055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.754249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.754511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.754768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.764933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.765204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.765470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.766007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.766454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.766733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.767000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.767280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.773969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.775262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.777235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.777509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.777897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.778181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.778510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.778774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.779046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.779358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.779633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.779942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.780213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.782674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.782954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.783353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.783639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.783925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.784190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.784464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.784741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.785023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.785299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.785570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.806556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.808729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.809005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.814192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.814450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.814725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.816433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.818049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.818359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.821816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.822095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.823889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.824167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.824445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.826764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.827052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.827334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.827616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.827889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.828162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.828432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.828699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.831602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.831885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.836411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.836698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.836981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.837264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.837538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.837812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.838084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.838525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.847093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.847369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.851920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.856321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.856626 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.858498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.858799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.861670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.863354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.865451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.867020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.867329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.869083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.869401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.870326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.870615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.870891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.871177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.873710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.877404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.881232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.881796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.881896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.882108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.882412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.882690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.890152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.890479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.891015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.891384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.899191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.901458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.901741 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.903244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.903632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.903908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.904176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.904756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.905036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.905316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.905609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.905890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.911927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.913599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.913874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.917444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.917723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.918127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.918435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.918713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.919055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.919330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.919609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.919888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.920164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.920435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.920716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.934478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.934758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.935039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.935329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.935620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.935896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.936173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.940467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.943800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.947045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.948814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.950441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.950721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.951008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.954360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.957556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.958279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.959815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.960808 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.962415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.962980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.963784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.964088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.964370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.964997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.965275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.965573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.972841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.973343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.973632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.973908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.974434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.977669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.977992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.978310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.978592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.982246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.982526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.982803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.983075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.983351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.983635 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.983914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.984189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.984454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.984729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.984997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.985262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.985634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.985892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.988655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.988944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.989223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.997541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 11:15:21.997822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.998101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.998406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.998681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.998950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.999232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.999514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:21.999791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:22.000060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:22.000337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:22.000598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:22.000861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:22.001140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 11:15:22.023258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a59543e9c0 pid: 79426 (default app) Jan 10 11:15:22.027330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939ccc-cfbc-4619-b7ca-61b48dbe0adf None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:22.027630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939ccc-cfbc-4619-b7ca-61b48dbe0adf None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:22.027911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939ccc-cfbc-4619-b7ca-61b48dbe0adf None None] PATH_INFO: `/v3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:22.032043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Jan 10 11:15:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:22.040081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a59543e9c0 pid: 79425 (default app) Jan 10 11:15:31.816249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0367-4e19-4be2-86cc-13ecd9d2b805 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:31.817255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0367-4e19-4be2-86cc-13ecd9d2b805 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:31.817255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0367-4e19-4be2-86cc-13ecd9d2b805 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:31.820313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:15:31.833771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:31.834627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:31.834627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:31.867749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG oslo_db.sqlalchemy.engines [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:15:32.165103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG passlib.handlers.bcrypt [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79425) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 10 11:15:32.165444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG passlib.handlers.bcrypt [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79425) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 10 11:15:32.244616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:32.247314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:32.394598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:32.570576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0367-4e19-4be2-86cc-13ecd9d2b805 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:32.606790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG oslo_db.sqlalchemy.engines [None req-cf6d0367-4e19-4be2-86cc-13ecd9d2b805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:15:32.844754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0367-4e19-4be2-86cc-13ecd9d2b805 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:32.849221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:32.849881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:32.850166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:32.850474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:32.859243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:32.911960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 10 11:15:32.912316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42e9b6-4fce-4d65-b521-7fbe881056aa admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:32.922877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:15:32.928863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:32.943653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480b1eb-6d69-4d69-be43-9bce99972eac None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:32.948211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:32.949322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:32.949612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:32.950503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:32.952298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:33.002921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 10 11:15:33.003262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025abb-3d3a-4ce4-96ec-97de6fb352da admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:33.007779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 2/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:32 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:35.473666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d87c-3439-4656-8aeb-d71cf6c85f08 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:35.474203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d87c-3439-4656-8aeb-d71cf6c85f08 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:35.474331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1d87c-3439-4656-8aeb-d71cf6c85f08 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:35.478778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 4/6] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:35.486047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:35.486505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:35.486657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:35.506258 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:35.507803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:35.516781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:35.539985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d87c-3439-4656-8aeb-d71cf6c85f08 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:35.552291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1d87c-3439-4656-8aeb-d71cf6c85f08 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:35.556616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2e9e-7283-4196-a6ef-872fa90fbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:35.557251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2e9e-7283-4196-a6ef-872fa90fbc2a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:35.557535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2e9e-7283-4196-a6ef-872fa90fbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:35.557804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2e9e-7283-4196-a6ef-872fa90fbc2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:35.568003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2e9e-7283-4196-a6ef-872fa90fbc2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:35.570203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2e9e-7283-4196-a6ef-872fa90fbc2a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:35.580228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:15:35.585848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:35.594998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada48a2-e3e0-42b7-aaf4-e87d83cacff4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:35.599327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f314b36-bf83-4c57-b9ed-565f15b5b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:35.600181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f314b36-bf83-4c57-b9ed-565f15b5b90e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:35.600463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f314b36-bf83-4c57-b9ed-565f15b5b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:35.600739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f314b36-bf83-4c57-b9ed-565f15b5b90e admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:35.602130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f314b36-bf83-4c57-b9ed-565f15b5b90e admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:35.605517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f314b36-bf83-4c57-b9ed-565f15b5b90e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:35.607208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 4/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:35 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:38.070737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f20ac-a99b-44b0-8484-e2008cd81438 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.071283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f20ac-a99b-44b0-8484-e2008cd81438 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.071283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f20ac-a99b-44b0-8484-e2008cd81438 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.073048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:38.078909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3f540-861d-481e-97c6-82bf2c5ed524 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.079357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3f540-861d-481e-97c6-82bf2c5ed524 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.079455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3f540-861d-481e-97c6-82bf2c5ed524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.097349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-bfc3f540-861d-481e-97c6-82bf2c5ed524 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:38.098588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bfc3f540-861d-481e-97c6-82bf2c5ed524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:38.106006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15e4b-501b-429a-a1ca-51feae9b7c26 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.106318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15e4b-501b-429a-a1ca-51feae9b7c26 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.106423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:38.106653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15e4b-501b-429a-a1ca-51feae9b7c26 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.108494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 7/12] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:15:38.114961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.115252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.115528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.130981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15e4b-501b-429a-a1ca-51feae9b7c26 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.133456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:38.134676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:38.142844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:38.143205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15e4b-501b-429a-a1ca-51feae9b7c26 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.147679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.148448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.148730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.149000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.165277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:38.166252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.172496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:15:38.173713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:15:38.175496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d4aa9-01c6-42d8-909f-c28e8892916a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.179373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.180111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.180747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.181033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.181304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.188743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8543-5c7b-47f0-9e13-1e0e90676d76 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.189345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:38.191159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:38.193194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.193817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.194097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.194398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.195148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:38.195448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:38.197180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:38.197180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:15:38.197180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:15:38.198087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:38.199832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:15:38.205898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.213736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:38.215578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07dea6-542e-43ba-be13-3842639cbedd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.219793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.220329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.220583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.220859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.221126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.224968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:38.226725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:38.228331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 8/17] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:38.234343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9716ec-a5d1-4653-8eea-1e9991cc1482 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.239091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.239998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.240284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.240564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.242828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:38.244854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:38.246818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:38.252828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.263991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138b86-8a8e-41db-9506-1b13ead19387 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.268748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85c801-27a5-402f-8fc9-33bb1458e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.269813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85c801-27a5-402f-8fc9-33bb1458e05a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.270097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85c801-27a5-402f-8fc9-33bb1458e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.270406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85c801-27a5-402f-8fc9-33bb1458e05a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.271672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85c801-27a5-402f-8fc9-33bb1458e05a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:38.273451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85c801-27a5-402f-8fc9-33bb1458e05a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:38.282758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:38.282898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:38.292207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1961b-c8c7-40ff-a33e-0594000fe10f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:38.297495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:38.298175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:38.298500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:38.298781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:38.299665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.domain.id=default, user.id=bed62ab9bae84e5e97211f8e6376a1d8) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:38.300048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:38.301105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:38.301105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:15:38.301105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:15:38.302386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077cd6-9434-4ce1-9dcb-da11c1a07dce admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:38.312920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1343 bytes} [Mon Jan 10 11:15:38 2022] GET /identity/v3/role_assignments?user.id=bed62ab9bae84e5e97211f8e6376a1d8&scope.domain.id=default&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:41.229293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4eba2-8f2d-4d1c-8d95-cc7c725eeb0b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.229807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4eba2-8f2d-4d1c-8d95-cc7c725eeb0b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.229907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4eba2-8f2d-4d1c-8d95-cc7c725eeb0b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.232253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:41.237417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770467a4-6d4c-4168-955f-87304b34055d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.238427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770467a4-6d4c-4168-955f-87304b34055d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.238910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770467a4-6d4c-4168-955f-87304b34055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.273376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05625e-1cac-4e48-a6c7-1d02c183da8d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.273986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05625e-1cac-4e48-a6c7-1d02c183da8d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.274508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05625e-1cac-4e48-a6c7-1d02c183da8d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.276787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:41.282548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.283139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.283622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.297444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG passlib.handlers.bcrypt [None req-770467a4-6d4c-4168-955f-87304b34055d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79426) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 10 11:15:41.297874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG passlib.handlers.bcrypt [None req-770467a4-6d4c-4168-955f-87304b34055d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79426) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 10 11:15:41.314242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:41.315928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:41.334710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:41.359337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-770467a4-6d4c-4168-955f-87304b34055d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:41.361019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-770467a4-6d4c-4168-955f-87304b34055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:41.371128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:41.386249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ed1f4-1f9c-4d71-92a0-dd42b87e776b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:41.391597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:41.392406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.392689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.392969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.398418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:41.421905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:41.437893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:15:41.439472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 13/25] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:41.445108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770467a4-6d4c-4168-955f-87304b34055d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:41.455818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770467a4-6d4c-4168-955f-87304b34055d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:41.465687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:41.470930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:41.471986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.472277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.472558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.473505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:41.473820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:41.475571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:41.475824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22bda5-be49-487b-ae1d-e0c36666dd9d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:41.491755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 13/26] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:41.492755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:41.493608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.494130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.494567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.495473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:41.497003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:41.497976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:41.497976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:41.497976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:41.500194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c408b1c-5b8f-4d7e-add7-0df472e44f05 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:41.512306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c0893-2d21-40ad-823d-8d9850d1afa9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:41.526454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:41.535196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.535196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.535196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.535196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:41.535196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:41.535196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:41 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:41.540375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:41.555161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235c578-5002-4c9e-ac4a-f73d64e759fb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:41.563269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:41.564108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.564399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.564680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.571056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:41.572836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:41.574578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 15/28] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:41.581501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:41.597748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cbc22-b152-4779-acf5-3579f6db5b39 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:41.606409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:41.608539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.609089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.609585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] PATH_INFO: `/v3/domains/default/users/bed62ab9bae84e5e97211f8e6376a1d8/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.611972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bed62ab9bae84e5e97211f8e6376a1d8, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:41.613295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:41.613295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:15:41.613295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:15:41.615717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab3aef-3f13-4270-bef6-25a79a24a559 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:41.727406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 14/29] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:15:41 2022] POST /identity/v3/roles => generated 219 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:15:41.734693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ecca6-64f8-4143-9d28-f0ba623a4221 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.735059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ecca6-64f8-4143-9d28-f0ba623a4221 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.735349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ecca6-64f8-4143-9d28-f0ba623a4221 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.737630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:41.742079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b323a-1ec1-438b-94e1-cd2f03db09f5 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.742079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b323a-1ec1-438b-94e1-cd2f03db09f5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.742079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b323a-1ec1-438b-94e1-cd2f03db09f5 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.746749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:41.748790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.749100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.749472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.802270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:41.804023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:41.854483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1382 bytes} [Mon Jan 10 11:15:41 2022] PUT /identity/v3/domains/default/users/bed62ab9bae84e5e97211f8e6376a1d8/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:15:41.856765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:41.857273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:41.857814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:41.880152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:41.882152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:41.964044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:41.979151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 17/34] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:42.000664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:42.010798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e15f0-16a9-4860-bbea-de33ba501f62 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:42.016303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:42.017430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:42.017899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:42.018472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:42.025401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:42.036339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00831b1-4045-47d6-a912-0638d9a9942d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:42.047305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:42.050246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:42.051804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:42.052720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:42.053211 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:42.053668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:42.054690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:42.056834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:42.056834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:15:42.056834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:15:42.058336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c03f1-aa88-41b2-b707-8009ace54926 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:42.084126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:15:42.085665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:42.093162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:42.104949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7710cd-9935-4092-9a92-65ac15ace4c0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:42.115097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:42.116073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:42.116512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:42.116939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:42.117862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:42.118416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:42.119784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:42.119784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:42.119784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:42.121008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:42.146160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 19/36] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:42.152011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:42.164828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da020982-8233-4ef9-9041-605ae783fe34 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:42.167659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:15:42 2022] POST /identity/v3/roles => generated 225 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:15:42.178336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:42.179047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:42.179338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:42.179647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:42.180401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:42.181515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:42.181515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:42.181515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:42.182981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10f6b5-fdbf-4df8-b65c-a9318c58ab9b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:42.306341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 20/38] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:15:42 2022] POST /identity/v3/projects => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:15:43.031242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62da4b-0415-43c0-8367-4bfe9b12717e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.031785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62da4b-0415-43c0-8367-4bfe9b12717e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.031785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62da4b-0415-43c0-8367-4bfe9b12717e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.033654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 19/39] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:43.038886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124a5f-93f7-4d1e-8c17-f2aa2b1717fe None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.039185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124a5f-93f7-4d1e-8c17-f2aa2b1717fe None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.039467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124a5f-93f7-4d1e-8c17-f2aa2b1717fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.057407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-01124a5f-93f7-4d1e-8c17-f2aa2b1717fe None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:43.058648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-01124a5f-93f7-4d1e-8c17-f2aa2b1717fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:43.116651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:43.142416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62da4b-0415-43c0-8367-4bfe9b12717e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:43.154962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62da4b-0415-43c0-8367-4bfe9b12717e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:43.159283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:43.159944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.160232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.160512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.161285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:43.162968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:43.256762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b540a-c5bb-451e-a922-aa06cbf2fd92 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.257055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b540a-c5bb-451e-a922-aa06cbf2fd92 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.257341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b540a-c5bb-451e-a922-aa06cbf2fd92 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.259164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 22/41] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:15:43.264164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.264987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.265250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.277680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:15:43 2022] POST /identity/v3/roles => generated 223 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:15:43.283741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:43.284900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:43.292919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:15:43.319220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:43.330078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbc6ed-7306-4a57-9edf-7455e095b052 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:43.334896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea35c7-5b08-4206-82ea-56f90a8cba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:43.335814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea35c7-5b08-4206-82ea-56f90a8cba79 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.336166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea35c7-5b08-4206-82ea-56f90a8cba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.336511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea35c7-5b08-4206-82ea-56f90a8cba79 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.337974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea35c7-5b08-4206-82ea-56f90a8cba79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:43.339873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea35c7-5b08-4206-82ea-56f90a8cba79 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:43.342026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 21/44] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:43.347749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:43.368699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6fc7-fa5f-4b46-8b9e-ca76e101f23c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:43.375365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a027531-a7d9-4f51-9005-6dbb35235d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:43.376069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027531-a7d9-4f51-9005-6dbb35235d49 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:43.376354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027531-a7d9-4f51-9005-6dbb35235d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:43.376623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a027531-a7d9-4f51-9005-6dbb35235d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:43.378995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a027531-a7d9-4f51-9005-6dbb35235d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:43.379678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a027531-a7d9-4f51-9005-6dbb35235d49 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:43.554131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 24/45] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:15:43 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:15:44.937828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c807-5434-4d75-b124-01194c8c40eb None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:44.938359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c807-5434-4d75-b124-01194c8c40eb None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:44.938359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527c807-5434-4d75-b124-01194c8c40eb None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:44.940220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 22/46] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:44.946005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:44.946655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:44.946655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:44.973372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:44.974645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:45.032380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 25/47] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:45.057178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c807-5434-4d75-b124-01194c8c40eb None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:45.069317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527c807-5434-4d75-b124-01194c8c40eb None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:45.073552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:45.074352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:45.074642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:45.074919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:45.085679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:45.092545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:15:45.094418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 23/48] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:45.100243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:45.109354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053759c-81f8-4752-b931-ad080e90e156 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:45.113758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:45.114452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:45.114741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:45.115023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:45.115803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:45.116109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:45.117141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:45.117141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:45.117141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:45.118058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:45.130898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:45.136449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:45.147627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc3b9a-2fb6-4303-9e0d-71a672b9beeb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:45.152153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:45.153015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:45.153303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:45.153583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:45.154840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:45.157243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:45.158864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 24/50] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:45 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:45.164683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:45.174799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43296-ab44-49be-bfd8-e98c25300e47 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:45.179273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f821bc2-fc62-4bd0-bf4e-0a85f0af46bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:45.180061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821bc2-fc62-4bd0-bf4e-0a85f0af46bc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:45.180344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821bc2-fc62-4bd0-bf4e-0a85f0af46bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:45.180618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821bc2-fc62-4bd0-bf4e-0a85f0af46bc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:45.181800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f821bc2-fc62-4bd0-bf4e-0a85f0af46bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:45.183578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f821bc2-fc62-4bd0-bf4e-0a85f0af46bc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:45.185315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 27/51] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:45.191551 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:45.201212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d29f-b36c-4dad-931c-edbe7cae4039 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:45.206805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:45.207452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:45.207740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:45.208020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:45.208867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.domain.id=default, user.id=bed62ab9bae84e5e97211f8e6376a1d8) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:45.209185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:45.211095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc54de-7a21-432a-a1f0-b3129540555d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:45.217158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 25/52] 10.222.0.20 () {56 vars in 1343 bytes} [Mon Jan 10 11:15:45 2022] GET /identity/v3/role_assignments?user.id=bed62ab9bae84e5e97211f8e6376a1d8&scope.domain.id=default&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:46.109653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4faf5-06b7-4f61-9b3b-60163377a730 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:46.110180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4faf5-06b7-4f61-9b3b-60163377a730 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:46.110180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4faf5-06b7-4f61-9b3b-60163377a730 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:46.112622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 28/53] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:46.118065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:46.118506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:46.118648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:46.136054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:46.137241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:46.144877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 26/54] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:46.170359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4faf5-06b7-4f61-9b3b-60163377a730 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:46.182889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4faf5-06b7-4f61-9b3b-60163377a730 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:46.187014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44723e41-cad0-4157-8ddf-4e2e3ae1c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:46.187789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44723e41-cad0-4157-8ddf-4e2e3ae1c90c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:46.188068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44723e41-cad0-4157-8ddf-4e2e3ae1c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:46.188347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44723e41-cad0-4157-8ddf-4e2e3ae1c90c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:46.189525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44723e41-cad0-4157-8ddf-4e2e3ae1c90c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:46.191268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44723e41-cad0-4157-8ddf-4e2e3ae1c90c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:46.192852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:46.198392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:46.208150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a96509-c98c-421f-8500-e5744a3d5556 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:46.212580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:46.213241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:46.213529 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:46.213815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:46.214582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:46.215642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:46.215642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:15:46.215642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:15:46.216859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef7015-0104-4b43-9803-1ff3dfe09a4f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:46.325060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 27/56] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Jan 10 11:15:46 2022] POST /identity/v3/projects => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:15:48.864462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0eae6-852d-4358-8a18-dbea0316f4d3 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:48.864975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0eae6-852d-4358-8a18-dbea0316f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:48.864975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0eae6-852d-4358-8a18-dbea0316f4d3 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:48.866734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 30/57] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:48.872595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:48.873019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:48.873159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:48.892051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:48.893420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:48.949273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 28/58] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:48.975778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0eae6-852d-4358-8a18-dbea0316f4d3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:48.988443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0eae6-852d-4358-8a18-dbea0316f4d3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:48.992772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531156d9-f543-4ec6-b4d6-b4bda31b2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:48.993553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531156d9-f543-4ec6-b4d6-b4bda31b2acd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:48.993837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531156d9-f543-4ec6-b4d6-b4bda31b2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:48.994110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531156d9-f543-4ec6-b4d6-b4bda31b2acd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:48.995314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531156d9-f543-4ec6-b4d6-b4bda31b2acd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:48.997012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531156d9-f543-4ec6-b4d6-b4bda31b2acd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:48.998625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 31/59] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:49.004229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:49.013249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb698f-5505-4232-9084-cf2557f1fb8c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:49.017651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:49.018334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:49.018620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:49.018892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:49.019624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:49.020641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:49.020641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:15:49.020641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:15:49.022144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21d90-74ce-4e05-a2dd-2887c7380cf8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:49.145452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 29/60] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:15:49 2022] POST /identity/v3/users => generated 275 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:15:52.586458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d45456-34ad-4405-95de-cc01e6acc8cf None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.586961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d45456-34ad-4405-95de-cc01e6acc8cf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.587035 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d45456-34ad-4405-95de-cc01e6acc8cf None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.589052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 32/61] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:52.598422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151711-b66e-44dd-9960-2921b63b022b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.598922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151711-b66e-44dd-9960-2921b63b022b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.598999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69151711-b66e-44dd-9960-2921b63b022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.630920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-69151711-b66e-44dd-9960-2921b63b022b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:52.632169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-69151711-b66e-44dd-9960-2921b63b022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:52.647530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 30/62] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:15:52.684700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d45456-34ad-4405-95de-cc01e6acc8cf None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:52.704105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d45456-34ad-4405-95de-cc01e6acc8cf None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:52.710389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:52.711191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.711472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.711747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.736746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:52.743653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:15:52.750860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 33/63] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:52.756584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151711-b66e-44dd-9960-2921b63b022b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:52.776447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69151711-b66e-44dd-9960-2921b63b022b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:52.783762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:52.784449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.784737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.785014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.785788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:52.786093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:52.787766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:52.802686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 31/64] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:52.807778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:52.828225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424943b-b17b-413e-a264-66c3d64fd6f3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:52.833885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:52.834801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.835084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.835357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.862149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:52.864391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:52.866312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 34/65] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:52 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:52.871806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:52.887849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b720788-ea81-4940-8710-a4a08ff22ac4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:52.903835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:52.904817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.905311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.905761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.922351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:52.924939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:52.940834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:15:52.946547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:52.960683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa43459-98f2-42ae-80ab-2eb79f60f463 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:52.978980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c4fb3-6a7d-48c3-9a36-740373973bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:52.979866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c4fb3-6a7d-48c3-9a36-740373973bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:52.980152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c4fb3-6a7d-48c3-9a36-740373973bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:52.980427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c4fb3-6a7d-48c3-9a36-740373973bf1 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:52.981701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c4fb3-6a7d-48c3-9a36-740373973bf1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:52.983806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c4fb3-6a7d-48c3-9a36-740373973bf1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:52.985905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 35/67] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:52 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:52.991666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.007591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ee67-d22f-45ed-82b0-0f5f1d9ecb55 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.014462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.015339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.015798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.016592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.017787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=4b7186691ce042baae497828f38e0fb3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.018314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.020365 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fed39-099d-455d-9fb0-adbb201b06d9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.030640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 33/68] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:15:52 2022] GET /identity/v3/role_assignments?user.id=4b7186691ce042baae497828f38e0fb3&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=c32977f9cff44544b097a3692528aa7c => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.063927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825abcc-acdd-487a-8ae3-9abb84fe90cb None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.064314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825abcc-acdd-487a-8ae3-9abb84fe90cb None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.064678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825abcc-acdd-487a-8ae3-9abb84fe90cb None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.066877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 36/69] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:53.072662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631872-e17b-400e-b126-ab2c664d5670 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.073282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631872-e17b-400e-b126-ab2c664d5670 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.073779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631872-e17b-400e-b126-ab2c664d5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.099437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-25631872-e17b-400e-b126-ab2c664d5670 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:53.101031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-25631872-e17b-400e-b126-ab2c664d5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:53.114983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:53.144905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1ba3-8d38-4a07-b3d8-c978fbcbec97 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.145196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1ba3-8d38-4a07-b3d8-c978fbcbec97 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.145643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd1ba3-8d38-4a07-b3d8-c978fbcbec97 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.148343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 37/71] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:53.153637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.153927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.154201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.160822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd1ba3-8d38-4a07-b3d8-c978fbcbec97 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.186572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:53.187789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:53.189927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd1ba3-8d38-4a07-b3d8-c978fbcbec97 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.196375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.197185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.197468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.197743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.209063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 35/72] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:53.214599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:53.222304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:15:53.223793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 38/73] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:53.229750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.239948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d1556-1780-45ad-8763-3fb68963f12c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.251296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.252061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.252352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.252631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.253417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.253728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.255453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.265296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 36/74] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.271400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.275312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.286015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb32168-93cc-4175-bf40-991b34d602d0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.286244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c997-3a0e-4f9b-a498-6386a9927127 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.294369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.295213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.296304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.297439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.297883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.298329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.298788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.299838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.303064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.305139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.310834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.317256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.324261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:53.335503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:15:53.337052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff17e-c8f3-4746-87ee-6a442f66d7ce admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.337164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:53.343774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.345945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.346659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.346948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.347232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.355882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.357693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.359685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1bd8e-83bc-4b4e-bd5c-8361b0c049fc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.368988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 38/77] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:15:53.371301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.372147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.372598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.373023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.374771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.375278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.375853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.377701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.384649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb37f9f-ebbe-4603-873a-1a14388787ef admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.389197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.390359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.390850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.391978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.393984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.396308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.397812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 40/78] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.398796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:53.403798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.406370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.419643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608ec4-48ea-4323-aa36-dcdeca9de0fa admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.423616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908b634-7abd-4fc2-9c88-9b008263c3d3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.426597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13d0f-2829-481e-8c1a-4f6fe249e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.427777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13d0f-2829-481e-8c1a-4f6fe249e9be admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.428264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13d0f-2829-481e-8c1a-4f6fe249e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.428649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13d0f-2829-481e-8c1a-4f6fe249e9be admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.428957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.429743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.430174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.430314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13d0f-2829-481e-8c1a-4f6fe249e9be admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.430707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.431687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=bed62ab9bae84e5e97211f8e6376a1d8) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.432139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.432870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13d0f-2829-481e-8c1a-4f6fe249e9be admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.434388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.434742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:53.436313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7d33-7e98-4957-aab6-90f82bc810e7 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.436703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7d33-7e98-4957-aab6-90f82bc810e7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.437229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7d33-7e98-4957-aab6-90f82bc810e7 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.442539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 40/82] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/role_assignments?user.id=bed62ab9bae84e5e97211f8e6376a1d8&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.450236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.450434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 42/82] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:53.450434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7f52-c9da-4ad3-8ffa-e2c724e3cad7 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.450434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7f52-c9da-4ad3-8ffa-e2c724e3cad7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.450434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7f52-c9da-4ad3-8ffa-e2c724e3cad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.466149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0deeb-b32c-42a0-bcfe-e40d0d042f96 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.477078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.477751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.478040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.478343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.491002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-cadc7f52-c9da-4ad3-8ffa-e2c724e3cad7 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:53.492263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cadc7f52-c9da-4ad3-8ffa-e2c724e3cad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:53.502262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.503371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.511992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:53.513561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfac3-806a-4f89-9a24-0fec9aa0e447 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.513859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfac3-806a-4f89-9a24-0fec9aa0e447 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.514142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dfac3-806a-4f89-9a24-0fec9aa0e447 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.517445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 44/84] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:53.523870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 41/85] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:15:53.525518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.525815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.526095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.529541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.549705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b56f7-286b-418e-b628-7898b04703e4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.555075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:53.555380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.556436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:53.556572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.556980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.557512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.558986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.561599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.564473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 42/86] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.565676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.566340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 45/87] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:53.570202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.582026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499f24f-ae67-4b91-8bd2-b59100733bc1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.588272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.589650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.589766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405703e-cc3d-443a-8082-d429d255522d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.590245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.590714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.591837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] RBAC: Adding query filter params (role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=4b7186691ce042baae497828f38e0fb3) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.592330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.594091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:53.594091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:53.594091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:53.597155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.599408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.600502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.600805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.601090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.604833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.606988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.607934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 46/88] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/role_assignments?user.id=4b7186691ce042baae497828f38e0fb3&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.608873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 43/89] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.615779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.619351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.628795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59556-b1fe-4ed2-8279-056157249d14 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.633585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.634321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.634616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.634900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.635659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.636733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:53.636733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:53.636733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:53.637255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444bae5-c77e-403e-9ea8-e001042d503d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.638011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.644177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.645469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.646115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.646654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.660970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:53.668676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:15:53.670580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 44/90] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:15:53.678022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.690645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb168f-c5ac-4e30-aefe-a4f622b6c087 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.696035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.697093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.697586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.698064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.699139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.699669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.701820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.713067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:53.720780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.732529 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609a6da-9203-41c5-8d1c-36987b1793c7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.740717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.742393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.742890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.743458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.745207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.747940 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.751726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:53.757472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.757883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 47/93] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:15:53 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:15:53.770639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07556bb-c5f9-4fa7-a055-6d415af44d2a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.776487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.777639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.778190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.778863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.789945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.793076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.804985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 47/94] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:15:53.811328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.832985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea6ba-7526-4123-a934-5bf9a90d431f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.848689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a34aaa-df5a-40b0-94e2-e73f349a50a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.849585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a34aaa-df5a-40b0-94e2-e73f349a50a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.849873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a34aaa-df5a-40b0-94e2-e73f349a50a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.850152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a34aaa-df5a-40b0-94e2-e73f349a50a7 admin admin] PATH_INFO: `/v3/projects/73f71f36465c485f9615a8462242ba9c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.855253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a34aaa-df5a-40b0-94e2-e73f349a50a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f71f36465c485f9615a8462242ba9c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.857428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a34aaa-df5a-40b0-94e2-e73f349a50a7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.859594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 48/95] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/projects/73f71f36465c485f9615a8462242ba9c => generated 312 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:53.866337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:53.881044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa273de2-b116-4244-95cc-7c04ecc0d191 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:53.887954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:53.889167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:53.889710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:53.890388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:53.892109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=73f71f36465c485f9615a8462242ba9c, user.id=4b7186691ce042baae497828f38e0fb3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:53.892851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:53.895205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c217d6-4361-420b-ab27-cd142fbd3aa4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:53.906065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 48/96] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:15:53 2022] GET /identity/v3/role_assignments?user.id=4b7186691ce042baae497828f38e0fb3&scope.project.id=73f71f36465c485f9615a8462242ba9c&role.id=c32977f9cff44544b097a3692528aa7c => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:56.277528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7737-8489-4133-b512-e0ee991a6d52 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.278158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7737-8489-4133-b512-e0ee991a6d52 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.278158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7737-8489-4133-b512-e0ee991a6d52 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.279926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 49/97] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:56.285963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a31c33-064b-4155-83ac-fa074bb5c1a2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.286989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a31c33-064b-4155-83ac-fa074bb5c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.287513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a31c33-064b-4155-83ac-fa074bb5c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.315302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-65a31c33-064b-4155-83ac-fa074bb5c1a2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:56.316912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-65a31c33-064b-4155-83ac-fa074bb5c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:56.325201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 49/98] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:56.330837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f13b1-b5da-46e5-acb6-21654f5786c9 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.331121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f13b1-b5da-46e5-acb6-21654f5786c9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.331397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f13b1-b5da-46e5-acb6-21654f5786c9 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.333170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 50/99] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:56.338758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.339307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.339800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.363233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f13b1-b5da-46e5-acb6-21654f5786c9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.366968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:56.368400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:56.379858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 50/100] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:56.392457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f13b1-b5da-46e5-acb6-21654f5786c9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.402346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.403155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.403438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.403714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.423399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:56.426891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.430662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:15:56.432276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 51/101] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:56.439170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.446759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db6970-64c7-419f-a8de-2d325cd20e2c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.454265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687fd55-8495-4a28-abe6-e256ed0765c9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.460382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.461582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.462065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.462589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.465943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.466735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.466955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.467235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.468110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:56.468326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.470740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.490016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:56.492275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:56.495393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.500020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:15:56.510239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 51/103] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:56.512432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.522042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d876c7-8ed1-4637-8b15-3af6011e6842 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.528079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30361727-90aa-49d0-aeaf-86634764ee99 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.539277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.539958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.540246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.540528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.541313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:56.541625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.543307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.545402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.546309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.546595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.546881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.548739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.551292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.552944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 53/104] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:56.561446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.569552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:56.579497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.582858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ab20-66fe-4d09-99b1-f7a8856486cc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.599553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8116b-ec04-4026-b68c-3229a8674cd8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.602718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.603590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.603875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.604156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.605777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.607930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.609676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 54/106] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:56.616414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.619889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.620792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.621076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.621359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.627590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.629480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.631515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 53/107] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:56.632873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15834276-ca1c-4f2b-a22e-3bc2e8034c35 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.636923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.652376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.653286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.653574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.653858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/4b7186691ce042baae497828f38e0fb3/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.659639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf921f7c464742a0bf047e27abb27e, user_id=4b7186691ce042baae497828f38e0fb3, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.660711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:15:56.660711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:15:56.660711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:15:56.661181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bac7f-5074-4a24-bd41-b9d6ef59bde2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.662746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88d7da-ed9b-4139-8b5b-4fd0be8d61f1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.670011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.670908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.671195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.671475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.672744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.679133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.682601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 54/108] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:56 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:56.687071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:56.699993 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d641ec7-55e6-41a1-86b7-299f9fcf5580 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:56.711680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d309ee6-4093-4979-8f2f-84dba8e6259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:56.712659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309ee6-4093-4979-8f2f-84dba8e6259b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:56.712953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309ee6-4093-4979-8f2f-84dba8e6259b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:56.713269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d309ee6-4093-4979-8f2f-84dba8e6259b admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/bed62ab9bae84e5e97211f8e6376a1d8/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:56.715620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d309ee6-4093-4979-8f2f-84dba8e6259b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf921f7c464742a0bf047e27abb27e, user_id=bed62ab9bae84e5e97211f8e6376a1d8, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:56.721137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d309ee6-4093-4979-8f2f-84dba8e6259b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:56.753375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 55/109] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:15:56 2022] PUT /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/4b7186691ce042baae497828f38e0fb3/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:15:56.821484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 55/110] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:15:56 2022] PUT /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/bed62ab9bae84e5e97211f8e6376a1d8/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:15:57.222562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053852-9961-43a5-b587-ed6d9c10682d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.222924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053852-9961-43a5-b587-ed6d9c10682d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.223095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b053852-9961-43a5-b587-ed6d9c10682d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.224812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 56/111] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:57.243098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065add9-13ae-4cdd-95d8-5bdc7452042b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.243425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065add9-13ae-4cdd-95d8-5bdc7452042b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.243653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065add9-13ae-4cdd-95d8-5bdc7452042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.267202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6065add9-13ae-4cdd-95d8-5bdc7452042b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:57.268439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6065add9-13ae-4cdd-95d8-5bdc7452042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:57.334094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:57.362593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b053852-9961-43a5-b587-ed6d9c10682d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.377974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b053852-9961-43a5-b587-ed6d9c10682d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.384407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.385210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.385469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.385757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.400644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:57.405939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73736b0-41d0-449c-a2d1-cc7ee53648d7 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.406256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73736b0-41d0-449c-a2d1-cc7ee53648d7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.406548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73736b0-41d0-449c-a2d1-cc7ee53648d7 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.409208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 57/113] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:57.413787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:15:57.414317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.414608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.414886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.419875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 57/114] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:57.420721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.434095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1738286-eec6-4ced-b16a-a3e2e6ebfd86 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.443332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:57.444548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:57.450888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.451600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.451873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.452150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.452927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:57.453237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.455042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.460764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:15:57.464300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 58/116] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:57.469811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.480214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881a543-fea5-42d9-bb76-337b4cb06f3c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.502370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.508904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.509801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.510087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.510395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.515034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.517283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.519012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 59/117] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:57.520117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b882-ecba-4627-bb87-b113969b14f7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.527775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.531940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.533326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.533595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.533873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.538695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e121e21-0e76-407b-b90b-0a1d766adc55 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.551986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.553254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.553804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.554326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.555817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.556223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:57.558505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.560548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 60/118] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:57.567795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:15:57.569065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 59/119] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:15:57.569972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.578415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.585308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e265-d0db-4943-87fd-6b6f7415fe36 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.591648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c039-ae9c-4b2c-8690-3736ca1ad25f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.593196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.594474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.595002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.596073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/4b7186691ce042baae497828f38e0fb3/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.598853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf921f7c464742a0bf047e27abb27e, user_id=4b7186691ce042baae497828f38e0fb3, role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.602062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.615567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.616253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.616541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.616825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.617608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:57.617920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.619600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.634080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 60/120] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:57.643876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.669968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83522bf-ff95-447b-ba13-14508c90e2f7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.679916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:15:57 2022] PUT /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/4b7186691ce042baae497828f38e0fb3/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:15:57.682010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.687554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.687554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.687554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.687554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.696503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.700173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 61/122] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:57.706812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.807787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169b12-37eb-4015-942b-cfde3ee3c4b3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.813602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b38ed1-8b12-4b49-9413-64e017dedff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.815235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b38ed1-8b12-4b49-9413-64e017dedff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.815733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b38ed1-8b12-4b49-9413-64e017dedff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.816344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b38ed1-8b12-4b49-9413-64e017dedff1 admin admin] PATH_INFO: `/v3/projects/73f71f36465c485f9615a8462242ba9c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.817852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b38ed1-8b12-4b49-9413-64e017dedff1 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f71f36465c485f9615a8462242ba9c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.820337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b38ed1-8b12-4b49-9413-64e017dedff1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:57.822711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 62/123] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:57 2022] GET /identity/v3/projects/73f71f36465c485f9615a8462242ba9c => generated 312 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:57.829990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:57.860300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44184c60-37a6-4206-ae23-78d1c1404d36 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:57.877241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797b66-6c09-4402-8a0d-d64f4fa9114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:57.878909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797b66-6c09-4402-8a0d-d64f4fa9114d admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:57.879428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797b66-6c09-4402-8a0d-d64f4fa9114d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:57.879947 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797b66-6c09-4402-8a0d-d64f4fa9114d admin admin] PATH_INFO: `/v3/projects/73f71f36465c485f9615a8462242ba9c/users/4b7186691ce042baae497828f38e0fb3/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:57.883531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797b66-6c09-4402-8a0d-d64f4fa9114d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f71f36465c485f9615a8462242ba9c, user_id=4b7186691ce042baae497828f38e0fb3, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:57.888990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797b66-6c09-4402-8a0d-d64f4fa9114d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.010708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 62/124] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:15:57 2022] PUT /identity/v3/projects/73f71f36465c485f9615a8462242ba9c/users/4b7186691ce042baae497828f38e0fb3/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:15:58.344705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f14da-3934-410d-8335-dc4e63b3516b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.344705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f14da-3934-410d-8335-dc4e63b3516b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.344705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f14da-3934-410d-8335-dc4e63b3516b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.347041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 63/125] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:15:58.352717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb43c6f-324f-41f0-8d80-514c80455f1a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.353013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb43c6f-324f-41f0-8d80-514c80455f1a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.353297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb43c6f-324f-41f0-8d80-514c80455f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.374372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5eb43c6f-324f-41f0-8d80-514c80455f1a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:58.375586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5eb43c6f-324f-41f0-8d80-514c80455f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:58.448776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 63/126] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:15:58.504241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f14da-3934-410d-8335-dc4e63b3516b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.524089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f14da-3934-410d-8335-dc4e63b3516b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.528618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e56bc-93b8-4af0-bde0-f6e4a99e8eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.529413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e56bc-93b8-4af0-bde0-f6e4a99e8eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.529696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e56bc-93b8-4af0-bde0-f6e4a99e8eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.529972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e56bc-93b8-4af0-bde0-f6e4a99e8eb6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.547443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e56bc-93b8-4af0-bde0-f6e4a99e8eb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:15:58.551733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90156-fa10-49be-bb6f-8df82bf16be4 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.552025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90156-fa10-49be-bb6f-8df82bf16be4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.552308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90156-fa10-49be-bb6f-8df82bf16be4 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.554094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 64/127] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:15:58.556236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-fb0e56bc-93b8-4af0-bde0-f6e4a99e8eb6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:15:58.557455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:15:58.563190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90156-fa10-49be-bb6f-8df82bf16be4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.570778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.571071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.571357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.590190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90156-fa10-49be-bb6f-8df82bf16be4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.594845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:15:58.596987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:15:58.611633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.612501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.612791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.613238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.614766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:15:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:15:58.628086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:58.628086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.628086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.646160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:15:58.651987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.668750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1676f-ff70-4f96-99d5-cb1f1718bb32 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.673897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.675112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.675640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.676144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] PATH_INFO: `/v3/users/c13c650baff6482380ff5efb0ec2d69d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.686594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.696104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] RBAC: Authorizing `identity:get_user(user_id=c13c650baff6482380ff5efb0ec2d69d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.698753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.700715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/users/c13c650baff6482380ff5efb0ec2d69d => generated 289 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:58.706454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77199ff9-4616-4c5c-ae9c-bfa2413fb5dc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.714359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.721248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.722367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.723645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.724091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.727125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.740455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.744706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be03d11-13c3-4464-b739-dea81c8b313b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.745191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:58.751177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.756380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.758109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.759694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.760116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.771857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4227ae-1d11-49de-a29c-458f83c6e666 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.787281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7b430-c7f8-45f4-a514-8448f6ef7cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.788918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.789874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b430-c7f8-45f4-a514-8448f6ef7cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.790909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b430-c7f8-45f4-a514-8448f6ef7cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.792068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7b430-c7f8-45f4-a514-8448f6ef7cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.793004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7b430-c7f8-45f4-a514-8448f6ef7cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.794072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.799686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7b430-c7f8-45f4-a514-8448f6ef7cb7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.821991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 67/133] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:15:58.826512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.840984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f488-e6c1-44c9-895c-26ffcfa7cc29 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.854229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.855291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.855743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.856182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.857562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.859914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.861874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 68/134] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:58.868008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:15:58.878607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bdb2a-e620-46e0-9c1a-0439b9db01cf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:15:58.886034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:15:58.886872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:15:58.887352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:15:58.887784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:15:58.888919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] RBAC: Adding query filter params (role.id=fadeade529264a9ab92847a557dddcd8, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=c13c650baff6482380ff5efb0ec2d69d) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:15:58.889382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:15:58.891463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef737-8b4c-4492-987c-e5bb1c60c674 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:15:58.902956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 69/135] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:15:58 2022] GET /identity/v3/role_assignments?user.id=c13c650baff6482380ff5efb0ec2d69d&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=fadeade529264a9ab92847a557dddcd8 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:15:58.950736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 67/136] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:15:58 2022] POST /identity/v3/projects => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:00.304840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc572c8e-7491-459b-95e1-104a1f93fb74 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.305695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc572c8e-7491-459b-95e1-104a1f93fb74 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.306259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc572c8e-7491-459b-95e1-104a1f93fb74 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.308728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 70/137] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:00.313956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.314992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.315473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.343491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:00.344732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:00.417019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:00.455132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc572c8e-7491-459b-95e1-104a1f93fb74 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:00.471509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc572c8e-7491-459b-95e1-104a1f93fb74 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:00.476181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:00.476983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.477270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.477553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.497449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:00.504592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:00.505968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 71/139] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:00.511444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:00.520604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748a92b-6d55-4cec-a568-b84fbf1a1d0a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:00.530289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:00.530964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.531251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.531535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.532303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:00.532616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:00.534899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:00.543707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:00.550002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:00.564012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f848-8e90-4144-b1cc-cacd86e227fc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:00.575016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:00.575912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.576203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.576490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.577842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:00.580617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:00.582732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 72/141] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:00 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:00.587958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:00.598840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3150dd-e101-4204-bf87-722922bf27a2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:00.606377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:00.607031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.607320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.607600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.616504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:00.618333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:00.634327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:00.641524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:00.660122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae049b-1bd6-4506-bd99-2e0e7a052384 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:00.667715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87fbd-303f-45aa-9276-70e5767a2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:00.668571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87fbd-303f-45aa-9276-70e5767a2bda admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.668860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87fbd-303f-45aa-9276-70e5767a2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.669125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87fbd-303f-45aa-9276-70e5767a2bda admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.670378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef87fbd-303f-45aa-9276-70e5767a2bda admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:00.672474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef87fbd-303f-45aa-9276-70e5767a2bda admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:00.674837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 73/143] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:00 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:00.680744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:00.690571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41ca82-8e53-4287-b648-92bac49d19d0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:00.698793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:00.699491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:00.699780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:00.700069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:00.700951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=4b7186691ce042baae497828f38e0fb3) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:00.701277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:00.703299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a3b54-5bc1-449f-a5de-d2aefe259c00 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:00.714774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:00 2022] GET /identity/v3/role_assignments?user.id=4b7186691ce042baae497828f38e0fb3&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=c32977f9cff44544b097a3692528aa7c => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.130490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632fea7-b788-4157-88c4-a3acf4375f2d None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.130868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632fea7-b788-4157-88c4-a3acf4375f2d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.131051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632fea7-b788-4157-88c4-a3acf4375f2d None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.132830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 74/145] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:01.138155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.138477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.138763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.163247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:01.164477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:01.172703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:01.211616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632fea7-b788-4157-88c4-a3acf4375f2d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.225111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632fea7-b788-4157-88c4-a3acf4375f2d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.230408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.231306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.231598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.231875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.252439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:01.259399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:01.264427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:01.267332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.281767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375195db-f19d-4374-a23f-4aadb5959d36 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.290930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.291636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.291922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.292202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.292995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:01.293302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.295044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.309090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.315689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.326872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51304a-49e1-44ee-a41a-afb1d3a3518c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.338126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.339082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.339418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.339777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] PATH_INFO: `/v3/users/bed62ab9bae84e5e97211f8e6376a1d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.342036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=bed62ab9bae84e5e97211f8e6376a1d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.344003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.346191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/users/bed62ab9bae84e5e97211f8e6376a1d8 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.352180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.367504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad718d-1ea0-4868-a805-bf0af0eb20c0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.372361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7069f-fa6b-4ed5-b9e5-fd33d98928ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.373034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7069f-fa6b-4ed5-b9e5-fd33d98928ac admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.373321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7069f-fa6b-4ed5-b9e5-fd33d98928ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.373603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7069f-fa6b-4ed5-b9e5-fd33d98928ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.386865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7069f-fa6b-4ed5-b9e5-fd33d98928ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.388588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7069f-fa6b-4ed5-b9e5-fd33d98928ac admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.402802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:01.408496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.419828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc014fe9-b4c5-4597-8cac-935abc194049 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.422127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc014fe9-b4c5-4597-8cac-935abc194049 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.422815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc014fe9-b4c5-4597-8cac-935abc194049 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.428064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932194-d102-49d7-a7da-e6ff924f00c9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.428557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 75/151] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:01.434857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.436014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.436549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.437050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.438471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.441287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.443618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 77/152] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.448469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.449054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.449533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.457868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.481816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e561a-6bac-460b-be0f-c0c69afdc5a1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.482937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:01.485082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:01.495407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.496481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.497904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.498778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.500222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=bed62ab9bae84e5e97211f8e6376a1d8) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:01.501676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.502656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:01.504836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.521038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 78/154] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/role_assignments?user.id=bed62ab9bae84e5e97211f8e6376a1d8&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.532525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.545697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6fb65-3310-4383-9380-0926f823cc86 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.551771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.553035 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.553544 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.554071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.573675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:01.582924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:01.584589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 77/155] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:01.590565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.604707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cba1a-7d07-4f69-8137-70651f684d05 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.609912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.611044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.611612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.612318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.613508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:01.614057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.616063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.628327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 79/156] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.634178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.646951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f6c2a-42d3-4918-b70b-622e25dace8f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.652742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.654026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.654594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.655072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.656823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.660670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.662787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 78/157] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.668707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.679883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f235f2-83c1-4056-964b-82844ce4e1ce admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.687220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.688362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.688861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.689442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.701377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.703758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.720424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:01.726959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.739849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeb906-50a4-4223-8a19-fd892c544a8f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.748208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624f58e-df3b-4399-818b-db946886375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.749078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f58e-df3b-4399-818b-db946886375e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.749363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f58e-df3b-4399-818b-db946886375e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.749635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f58e-df3b-4399-818b-db946886375e admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.750916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624f58e-df3b-4399-818b-db946886375e admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.754122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624f58e-df3b-4399-818b-db946886375e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.755819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 79/159] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:01.761914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:01.776005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27096d2c-c1cb-490e-ae1f-74bf4c428968 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:01.781174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:01.782258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:01.794441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:01.794441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:01.794441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] RBAC: Adding query filter params (role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=4b7186691ce042baae497828f38e0fb3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:01.794441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:01.794441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e287-7602-434e-99b0-922bbe28c45f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:01.797570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 81/160] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:01 2022] GET /identity/v3/role_assignments?user.id=4b7186691ce042baae497828f38e0fb3&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:02.010873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c360f1-0fcd-435b-b054-3c5c18bfe254 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.011253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c360f1-0fcd-435b-b054-3c5c18bfe254 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.011428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c360f1-0fcd-435b-b054-3c5c18bfe254 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.013243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 80/161] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:02.019726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.020021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.020298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.045000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:02.046236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:02.058285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:02.084321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c360f1-0fcd-435b-b054-3c5c18bfe254 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.099564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c360f1-0fcd-435b-b054-3c5c18bfe254 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.103937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.104726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.105006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.105280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.117637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:02.124996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:02.126239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:02.132756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.145144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad976303-2c8a-4f58-aefb-3af835cbd687 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.150813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.151478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.151762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.152034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.152797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:02.153098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.154719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.166551 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:02.171842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.182243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e06da-f5b2-4648-b9e1-f685aad05faa admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.186897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.187798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.188133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.188398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] PATH_INFO: `/v3/users/4b7186691ce042baae497828f38e0fb3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.189777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b7186691ce042baae497828f38e0fb3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.192134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.194174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/users/4b7186691ce042baae497828f38e0fb3 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:02.199552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.210511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7a86f-1f32-4894-b6d0-11067b9de72c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.215226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.216148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.216680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.217176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.226673 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.228784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.238432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 84/166] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:02.243490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.254148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b273a-30dd-4a91-8bc0-6bfcbc51ca52 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.258978 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb78f4-ee20-4742-88cd-6fa3cc2939d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.260037 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb78f4-ee20-4742-88cd-6fa3cc2939d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.260455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb78f4-ee20-4742-88cd-6fa3cc2939d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.260861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb78f4-ee20-4742-88cd-6fa3cc2939d2 admin admin] PATH_INFO: `/v3/projects/73f71f36465c485f9615a8462242ba9c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.262291 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb78f4-ee20-4742-88cd-6fa3cc2939d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=73f71f36465c485f9615a8462242ba9c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.264488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb78f4-ee20-4742-88cd-6fa3cc2939d2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.266286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/projects/73f71f36465c485f9615a8462242ba9c => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:02.272775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.281821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d14dd-2766-4900-8803-92ddee1a59bc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.286807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.287438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.287717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.287988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.288828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=73f71f36465c485f9615a8462242ba9c, user.id=4b7186691ce042baae497828f38e0fb3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:02.289132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.291014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af80471-1ce3-4dc9-9405-fb6c71fd4e73 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.297319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 85/168] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/role_assignments?user.id=4b7186691ce042baae497828f38e0fb3&scope.project.id=73f71f36465c485f9615a8462242ba9c&role.id=c32977f9cff44544b097a3692528aa7c => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:02.438395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65a9a-c26f-469e-b77e-859d02c29ae5 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.438906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65a9a-c26f-469e-b77e-859d02c29ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.439008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e65a9a-c26f-469e-b77e-859d02c29ae5 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.441933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 84/169] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:02.447527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.448030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.448101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.467006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:02.468213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:02.476192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 86/170] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:02.499901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65a9a-c26f-469e-b77e-859d02c29ae5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.518548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e65a9a-c26f-469e-b77e-859d02c29ae5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.523058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.524015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.524629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.524971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.537360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:02.544274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:02.545729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 85/171] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:02.551372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.560411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abf29b-1d6d-49f8-85e1-eca4be7fa449 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.565296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.565974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.566293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.566553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.567323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:02.567628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.569239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.578067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 87/172] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:02.584482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.595026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c45c47-a560-4b85-9fc9-ca7281fd6e8b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.599604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.600458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.600731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.600997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] PATH_INFO: `/v3/users/c13c650baff6482380ff5efb0ec2d69d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.602183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] RBAC: Authorizing `identity:get_user(user_id=c13c650baff6482380ff5efb0ec2d69d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.604423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.606058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 86/173] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/users/c13c650baff6482380ff5efb0ec2d69d => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:02.611950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.622534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f96b-6090-41a6-84a0-6d4405f6d0fb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.626896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26213cf-05c8-41d6-9dbc-b02ac2200adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.628333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26213cf-05c8-41d6-9dbc-b02ac2200adc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.628611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26213cf-05c8-41d6-9dbc-b02ac2200adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.628882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26213cf-05c8-41d6-9dbc-b02ac2200adc admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.630083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26213cf-05c8-41d6-9dbc-b02ac2200adc admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.632168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26213cf-05c8-41d6-9dbc-b02ac2200adc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.633833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 88/174] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:02.639558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.660810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc694be-56ce-4cc5-b7d3-0ae9a78e6df2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.665272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0287e0b-e22f-4b74-8fab-3a894829b729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.667373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287e0b-e22f-4b74-8fab-3a894829b729 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.668109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287e0b-e22f-4b74-8fab-3a894829b729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.668388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0287e0b-e22f-4b74-8fab-3a894829b729 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/c13c650baff6482380ff5efb0ec2d69d/roles/fadeade529264a9ab92847a557dddcd8` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.670416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0287e0b-e22f-4b74-8fab-3a894829b729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf921f7c464742a0bf047e27abb27e, user_id=c13c650baff6482380ff5efb0ec2d69d, role_id=fadeade529264a9ab92847a557dddcd8)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.673087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0287e0b-e22f-4b74-8fab-3a894829b729 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.755190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 87/175] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:02 2022] PUT /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e/users/c13c650baff6482380ff5efb0ec2d69d/roles/fadeade529264a9ab92847a557dddcd8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:02.788089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea90c3-aa0d-4096-9538-c4d6f70f1219 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.788285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea90c3-aa0d-4096-9538-c4d6f70f1219 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.788553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea90c3-aa0d-4096-9538-c4d6f70f1219 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.790445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 89/176] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:02.796240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.796537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.796778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.816313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:02.817533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:02.881577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 88/177] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:02.909696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea90c3-aa0d-4096-9538-c4d6f70f1219 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.922044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea90c3-aa0d-4096-9538-c4d6f70f1219 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.926537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816e504-8824-4806-8f90-232f6100999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.927347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e504-8824-4806-8f90-232f6100999e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.927629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e504-8824-4806-8f90-232f6100999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.927903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816e504-8824-4806-8f90-232f6100999e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.929121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e504-8824-4806-8f90-232f6100999e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.930878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816e504-8824-4806-8f90-232f6100999e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:02.932513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 90/178] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:02.938176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:02.947521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8b7bd-5b99-4c41-8c75-7ec10a340485 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:02.951905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadefa47-6b08-448d-a30b-b325da57e831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:02.952594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadefa47-6b08-448d-a30b-b325da57e831 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:02.952875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadefa47-6b08-448d-a30b-b325da57e831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:02.953150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadefa47-6b08-448d-a30b-b325da57e831 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:02.953896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadefa47-6b08-448d-a30b-b325da57e831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:02.956730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadefa47-6b08-448d-a30b-b325da57e831 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:03.087669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 89/179] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:02 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:05.277309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c063-69a1-4f23-8103-61829e723980 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.277827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c063-69a1-4f23-8103-61829e723980 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.277902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c063-69a1-4f23-8103-61829e723980 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.279702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 91/180] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:05.285706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.286256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.286348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.306518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:05.307751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:05.316909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 90/181] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:05.342611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9c063-69a1-4f23-8103-61829e723980 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.356478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9c063-69a1-4f23-8103-61829e723980 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.361209 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.361985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.362970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.363437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.376199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:05.384591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:05.386066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 92/182] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:05.392021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.402583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcb318-a904-4b82-b0aa-011fea7be31a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.407322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.408017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.408298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.408576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.409960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:05.410543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.412249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.422007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 91/183] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:05.428725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.439219 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40542f-59db-45ff-b204-e73339aa605b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.444253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.445107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.445391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.445666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] PATH_INFO: `/v3/users/c13c650baff6482380ff5efb0ec2d69d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.447036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] RBAC: Authorizing `identity:get_user(user_id=c13c650baff6482380ff5efb0ec2d69d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.449218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.450880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 93/184] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/users/c13c650baff6482380ff5efb0ec2d69d => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:05.456826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.466872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d65d-9c0e-41a9-ba8d-93d3ddc873d2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.471304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.472602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.473094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.473473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.481903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.484037 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.494592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 92/185] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:05.500121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.510564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37482a48-bcfe-43aa-b578-c9a19ecd2789 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.515075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54aca-0682-4726-87a4-873a600be367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.515926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54aca-0682-4726-87a4-873a600be367 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.516210 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54aca-0682-4726-87a4-873a600be367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.516490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54aca-0682-4726-87a4-873a600be367 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.517699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f54aca-0682-4726-87a4-873a600be367 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.520327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f54aca-0682-4726-87a4-873a600be367 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.521975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 94/186] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:05.528270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.538520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d403b-9dfa-4436-bc99-2fc2b6b25dee admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.543051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.543700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.543980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.544255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.545105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] RBAC: Adding query filter params (role.id=fadeade529264a9ab92847a557dddcd8, scope.project.id=c3bf921f7c464742a0bf047e27abb27e, user.id=c13c650baff6482380ff5efb0ec2d69d) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:05.545415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.547478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19563dc4-7301-47a9-b18c-5ebc528387f8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.556063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 93/187] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/role_assignments?user.id=c13c650baff6482380ff5efb0ec2d69d&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=fadeade529264a9ab92847a557dddcd8 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:05.668767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7581b2-1f64-48fc-a128-d3918594320a None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.668767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7581b2-1f64-48fc-a128-d3918594320a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.668767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7581b2-1f64-48fc-a128-d3918594320a None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.668767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 95/188] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:05.675253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.675867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.676412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.695982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:05.697627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:05.706064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:05.732191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7581b2-1f64-48fc-a128-d3918594320a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.745348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7581b2-1f64-48fc-a128-d3918594320a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.750405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.751621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.752103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.752573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.765173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:05.773533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:05.776189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 96/190] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:05.784663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.794980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13425da7-ef30-46af-a891-4d8db456eb61 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.800636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.802030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.802030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.802197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.802931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:05.803234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.804879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816801-92be-441e-9215-03e84fd7194e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.813998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 95/191] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:05.819481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.829386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c247d05-764a-419d-a5b5-e0a70bc04107 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.831961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4861b5c-3159-443b-a967-29155b3c2c13 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.834874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4861b5c-3159-443b-a967-29155b3c2c13 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.834874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4861b5c-3159-443b-a967-29155b3c2c13 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.834874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 96/192] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:05.835101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42f673-d8d1-4067-907c-975b62e3eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.835413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f673-d8d1-4067-907c-975b62e3eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.835651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f673-d8d1-4067-907c-975b62e3eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.835908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42f673-d8d1-4067-907c-975b62e3eb8e admin admin] PATH_INFO: `/v3/users/397a9d35ff8d40098deafbc10ab38395` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.839795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1042-be99-4e49-b441-2dd40d9c60b8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.840073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1042-be99-4e49-b441-2dd40d9c60b8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.840339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1042-be99-4e49-b441-2dd40d9c60b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.941884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8aae1042-be99-4e49-b441-2dd40d9c60b8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:05.942083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f673-d8d1-4067-907c-975b62e3eb8e admin admin] RBAC: Authorizing `identity:get_user(user_id=397a9d35ff8d40098deafbc10ab38395)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.943162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8aae1042-be99-4e49-b441-2dd40d9c60b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:05.944272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42f673-d8d1-4067-907c-975b62e3eb8e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.945969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 97/193] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/users/397a9d35ff8d40098deafbc10ab38395 => generated 283 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:05.947300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54c378-b463-4f4d-b198-ee6ca0eae5dd None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.947601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54c378-b463-4f4d-b198-ee6ca0eae5dd None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.947878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54c378-b463-4f4d-b198-ee6ca0eae5dd None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.949501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 98/194] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:05.951355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54c378-b463-4f4d-b198-ee6ca0eae5dd None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.952117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 97/195] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:05.954703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.954977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.955252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.964048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54c378-b463-4f4d-b198-ee6ca0eae5dd None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.968470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.969088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.969463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.969702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:05.973958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:05.975202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:05.978607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:05.980355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:05.982675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 98/196] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:05.983439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.994130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:16:05.994388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341bed2-5b80-44dd-af12-fae97073f511 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:05.994996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:05.996613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:05.997391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:05.997665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:05.997930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.004413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb209e-0dd9-435b-b3a7-d8906be97f03 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.008415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:06.009692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.010556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.010834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.011104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.012266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.014330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.015658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:06.016100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 100/198] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:06.016931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.017032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 99/199] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:06.023204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.028547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f551ec9-417e-4738-9632-bc323ab013bc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.032583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0622a-fd05-42fb-a909-8ca0066e7cc5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.032986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.033726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.034003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.034439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.036235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.037701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.037852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.038348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.038630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.038904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.039437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 101/200] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:06.039746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=397a9d35ff8d40098deafbc10ab38395) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:06.040052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.040164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.041997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.048443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 100/201] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/role_assignments?user.id=397a9d35ff8d40098deafbc10ab38395&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:06.049028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.060127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de47c28-6e5c-4fc1-b99b-675233408dee admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.062538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c3acc-20da-48ff-accd-92a25a11379d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.064706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df436d58-3038-40f0-b9b6-8425a409f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.065415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df436d58-3038-40f0-b9b6-8425a409f304 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.065837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df436d58-3038-40f0-b9b6-8425a409f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.065987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df436d58-3038-40f0-b9b6-8425a409f304 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.066738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df436d58-3038-40f0-b9b6-8425a409f304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.067771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.068512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.068725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df436d58-3038-40f0-b9b6-8425a409f304 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.068914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.069247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.070115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:06.070473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.072169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.082367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 102/202] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:06.088051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.099387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996051b-5750-44f3-8bb6-dd410e276c04 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.104000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.104881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.105161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.105425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] PATH_INFO: `/v3/users/397a9d35ff8d40098deafbc10ab38395` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.106734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=397a9d35ff8d40098deafbc10ab38395)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.108917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.111055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 103/203] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/users/397a9d35ff8d40098deafbc10ab38395 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:06.117631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.127744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ece218-c59c-4b9c-a1e5-6444fee5b9d8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.133173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.133998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.134313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.134590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.143457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.145894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.156034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 104/204] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:16:06.162601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.171534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb563e-21e5-42de-a87d-9936a2887d9a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.176025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.176890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.177169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.177443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.185736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.185736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.185736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 105/205] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:06.188775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:06.199750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a46d9-9849-43cd-9eec-e7f9883b9332 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:06.204102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:06.204753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:06.205030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:06.205302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:06.206816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] RBAC: Adding query filter params (role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=397a9d35ff8d40098deafbc10ab38395) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:06.207270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:06.209291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06e52f-e1ea-469a-a28f-cab3fc01ca8e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:06.215554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 106/206] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:06 2022] GET /identity/v3/role_assignments?user.id=397a9d35ff8d40098deafbc10ab38395&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:06.223772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 101/207] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:06 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:08.509540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d15d04-ec9a-491a-b8c9-493dcb97ac3d None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.509966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d15d04-ec9a-491a-b8c9-493dcb97ac3d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.510154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d15d04-ec9a-491a-b8c9-493dcb97ac3d None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.511930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 107/208] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:08.517567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.518018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.518242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.536843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:08.538041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:08.545880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 102/209] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:08.571186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d15d04-ec9a-491a-b8c9-493dcb97ac3d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.583777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d15d04-ec9a-491a-b8c9-493dcb97ac3d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.588251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.589036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.589321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.589599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.601360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:08.608410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:08.614328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 108/210] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:08.616805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.625999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585dcb3-584c-4203-ac1a-fa38c87a2144 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.631144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.631812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.632092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.632372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.633144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:08.633451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.635116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.644812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 103/211] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:08.650323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.660854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bcc90-539a-4de5-a8d4-59f6a85d6e6b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.667470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40457fb7-54ee-4b71-ada7-6f154d9a8b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.668337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40457fb7-54ee-4b71-ada7-6f154d9a8b6a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.668620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40457fb7-54ee-4b71-ada7-6f154d9a8b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.668897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40457fb7-54ee-4b71-ada7-6f154d9a8b6a admin admin] PATH_INFO: `/v3/users/397a9d35ff8d40098deafbc10ab38395` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.670123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40457fb7-54ee-4b71-ada7-6f154d9a8b6a admin admin] RBAC: Authorizing `identity:get_user(user_id=397a9d35ff8d40098deafbc10ab38395)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.672302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40457fb7-54ee-4b71-ada7-6f154d9a8b6a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.674069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 109/212] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/users/397a9d35ff8d40098deafbc10ab38395 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:08.679585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.689443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee94f3-5860-471f-a24a-9a2e9557f8c7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.690872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6afab-b4c5-45e2-b73b-00b2c3195a96 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.691695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6afab-b4c5-45e2-b73b-00b2c3195a96 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.691973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6afab-b4c5-45e2-b73b-00b2c3195a96 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.694310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 110/213] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:08.698533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.699110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.699393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.699670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.700223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.700681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.701124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.702569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.704825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.707461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 104/214] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:08.713412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.719766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:08.721194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:08.724958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c3107-e9a2-4d44-93c5-3bc55ac5c2f3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.730686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161789dc-22b4-4a46-9568-dfe3b81658df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.732045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161789dc-22b4-4a46-9568-dfe3b81658df admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.732455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161789dc-22b4-4a46-9568-dfe3b81658df admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.732706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161789dc-22b4-4a46-9568-dfe3b81658df admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/397a9d35ff8d40098deafbc10ab38395/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.735365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161789dc-22b4-4a46-9568-dfe3b81658df admin admin] RBAC: Authorizing `identity:create_grant(project_id=af16a3c6af664ea2a810122145c3aaa5, user_id=397a9d35ff8d40098deafbc10ab38395, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.737079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 111/215] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:08.741532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161789dc-22b4-4a46-9568-dfe3b81658df admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.763416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.772439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454cb8d-1fcf-4a78-8217-1403d5fc7d9b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.777023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.777821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.778101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.778410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.789339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:08.796613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:08.798019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 112/216] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:08.803911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.813452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ab088-3c3c-4fea-acbc-a7d2061e45e8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.817817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.818524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.818812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.819084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.819845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:08.820146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.821750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.830976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 113/217] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:08.832598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 105/218] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:08 2022] PUT /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/397a9d35ff8d40098deafbc10ab38395/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:16:08.837649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.842569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cb23d-8808-4e1b-aa11-42eb0d851c0e None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.842858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cb23d-8808-4e1b-aa11-42eb0d851c0e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.843130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cb23d-8808-4e1b-aa11-42eb0d851c0e None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.845286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 106/219] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:08.851191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4479ed-f432-44ac-9c1c-bc45601f7029 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.851797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4479ed-f432-44ac-9c1c-bc45601f7029 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.852315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4479ed-f432-44ac-9c1c-bc45601f7029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.852533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4ce75-b451-4a01-b752-998a210643f6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.891269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-eb4479ed-f432-44ac-9c1c-bc45601f7029 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:08.892826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-eb4479ed-f432-44ac-9c1c-bc45601f7029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:08.924655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.926312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.926845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.927885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] PATH_INFO: `/v3/users/397a9d35ff8d40098deafbc10ab38395` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.930374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] RBAC: Authorizing `identity:get_user(user_id=397a9d35ff8d40098deafbc10ab38395)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.933861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.936078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 114/220] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/users/397a9d35ff8d40098deafbc10ab38395 => generated 283 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:08.943292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.957761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422e82-ae2e-40fd-a0c6-bc23c446878c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.962782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.963889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.964374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.964816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.965494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 107/221] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:08.966516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.968161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a6cd5-b3b7-4d95-adc4-45fd49c5abc3 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.968556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a6cd5-b3b7-4d95-adc4-45fd49c5abc3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.968929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a6cd5-b3b7-4d95-adc4-45fd49c5abc3 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.969366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:08.971194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 108/222] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:08.976897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 115/223] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:08 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:08.977911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.978247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:08.978467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.978837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.990561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22249-e90f-46b7-ada4-5e59d92db578 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:08.995244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:08.996138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:08.996414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:08.996684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/397a9d35ff8d40098deafbc10ab38395/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:08.998747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:08.999005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af16a3c6af664ea2a810122145c3aaa5, user_id=397a9d35ff8d40098deafbc10ab38395, role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:08.999956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:09.001688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.007882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 109/224] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:09.008566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.018443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45244de5-ec44-4a35-a7d6-720cf7a3a67a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.023432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.024243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.024520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.024792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.036825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:09.043982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:09.045231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 110/225] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:09.050316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.056708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4677fa-41fa-4ccb-84d7-7e42ba604d18 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.064200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.064200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.064200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.064200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.064568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.065526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.068098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:09.068674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.079191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021ea8a-6908-44cf-ba5a-e2c497c84b03 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.083940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.084689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.084918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.085246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.086048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:09.086368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.087978 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.096609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 112/227] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:09.100989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.104051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 116/228] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:08 2022] PUT /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/397a9d35ff8d40098deafbc10ab38395/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:09.106760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.118591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529643a-a7d6-4486-98a0-89b76a7ad7d0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.180949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f85a9-24fc-4f08-bff9-4f52f9189d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.181629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f85a9-24fc-4f08-bff9-4f52f9189d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.181910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f85a9-24fc-4f08-bff9-4f52f9189d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.182185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f85a9-24fc-4f08-bff9-4f52f9189d10 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.182959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f85a9-24fc-4f08-bff9-4f52f9189d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.184982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f85a9-24fc-4f08-bff9-4f52f9189d10 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.195072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e446b-603a-4897-9e6c-e53decfb1df9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.201029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.202442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.202984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.203487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] PATH_INFO: `/v3/users/4fd7c6359dee4a4e92f1445249b938a9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.220924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] RBAC: Authorizing `identity:get_user(user_id=4fd7c6359dee4a4e92f1445249b938a9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.224195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.226603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/users/4fd7c6359dee4a4e92f1445249b938a9 => generated 297 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:09.232376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.243361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132eacc2-4273-41fb-a205-e97db1930d4e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.248052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.248716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.250903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.250903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.258926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.260831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.271692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 118/230] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:16:09.277337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.287331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d28f3-09c3-46ec-9e67-c6adedd85892 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.291873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.293146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.293146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.293294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.294632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.296726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.304128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 119/231] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:09.305304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:09.315785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689d8c0-715e-42ab-bc9e-93f957d092ba admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:09.320707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:09.321490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:09.321770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:09.322096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:09.322994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=4fd7c6359dee4a4e92f1445249b938a9) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:09.323356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:09.325333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b1880-173a-4a3d-a389-a1c6074ad4d2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:09.333877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 120/232] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:09 2022] GET /identity/v3/role_assignments?user.id=4fd7c6359dee4a4e92f1445249b938a9&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=c32977f9cff44544b097a3692528aa7c => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:09.336138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 113/233] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:09 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:11.672290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233fd3d-b723-4025-8121-2172a09a5328 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.672798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233fd3d-b723-4025-8121-2172a09a5328 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.672870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233fd3d-b723-4025-8121-2172a09a5328 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.674817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 121/234] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:11.681158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.681609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.681714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.702708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:11.703903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:11.711656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 114/235] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:11.753468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233fd3d-b723-4025-8121-2172a09a5328 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:11.768089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233fd3d-b723-4025-8121-2172a09a5328 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:11.777397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:11.778176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.778483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.778753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.791661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:11.799934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:11.802412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 122/236] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:11.808404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:11.817696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62510ff-f2a6-4469-a6d5-5c10a161de22 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:11.828200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:11.828873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.829147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.829412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.830233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:11.830539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:11.832740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:11.841935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 115/237] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:11.847699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:11.864061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e4b36-5e93-4dfb-bba5-d01af137735e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:11.871602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:11.883671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.883671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.883671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] PATH_INFO: `/v3/users/397a9d35ff8d40098deafbc10ab38395` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.883671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] RBAC: Authorizing `identity:get_user(user_id=397a9d35ff8d40098deafbc10ab38395)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:11.883671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:11.883671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 123/238] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:11 2022] GET /identity/v3/users/397a9d35ff8d40098deafbc10ab38395 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:11.889610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:11.900431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ab396-4cd0-4773-a150-1fc03f303161 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:11.914272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:11.914942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.915219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.915490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.924271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:11.926249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:11.936689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 116/239] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:11.943290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:11.961112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c974fd2-8a11-4ae0-aed7-7b9448b64f2f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:11.974918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef11c6-b525-48a2-b355-55a0bc1c5387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:11.975789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef11c6-b525-48a2-b355-55a0bc1c5387 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:11.976068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef11c6-b525-48a2-b355-55a0bc1c5387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:11.976341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef11c6-b525-48a2-b355-55a0bc1c5387 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:11.977603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef11c6-b525-48a2-b355-55a0bc1c5387 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:11.979770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef11c6-b525-48a2-b355-55a0bc1c5387 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:11.981665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 124/240] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:11 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:11.987679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.001617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605f0e0-8f40-42f8-a8af-132db16307cf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.006514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.007165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.007445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.007754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.008592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=397a9d35ff8d40098deafbc10ab38395) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:12.008899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.010829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0493fb-1667-4f41-a973-1578de0b3b9f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.022299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 117/241] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:11 2022] GET /identity/v3/role_assignments?user.id=397a9d35ff8d40098deafbc10ab38395&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.171028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b249b-f753-495b-a6c0-be6b63fc74ce None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.171361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b249b-f753-495b-a6c0-be6b63fc74ce None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.171570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b249b-f753-495b-a6c0-be6b63fc74ce None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.173432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 125/242] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:12.180011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.180333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.180550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.208763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:12.209991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:12.218146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 118/243] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:12.258656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b249b-f753-495b-a6c0-be6b63fc74ce None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.281012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b249b-f753-495b-a6c0-be6b63fc74ce None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.290470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.291275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.291553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.291824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.314794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:12.322113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:12.323403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 126/244] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:12.329521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.342351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54d729-8b24-4ca3-b5e5-23a3b3cdede4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.346777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.347730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.348690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.348965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.349840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:12.350143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.356298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.369094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 119/245] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.374846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.395526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2cbe0-aabc-428d-8578-b1c1abcc49c9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.400373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.401550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.401868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.402153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] PATH_INFO: `/v3/users/4fd7c6359dee4a4e92f1445249b938a9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.403452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] RBAC: Authorizing `identity:get_user(user_id=4fd7c6359dee4a4e92f1445249b938a9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.405784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.407423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 127/246] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/users/4fd7c6359dee4a4e92f1445249b938a9 => generated 297 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.414109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.424534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a406dd-e18c-4386-8beb-b3aca594aa4b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.429862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ae328-f913-4857-a62d-2e02e11e065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.431877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ae328-f913-4857-a62d-2e02e11e065b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.432160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ae328-f913-4857-a62d-2e02e11e065b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.432432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ae328-f913-4857-a62d-2e02e11e065b admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.433693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ae328-f913-4857-a62d-2e02e11e065b admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.435937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ae328-f913-4857-a62d-2e02e11e065b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.438028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 120/247] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.443796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.455031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8e66-0588-485e-b75d-69b1fe196013 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.459966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afcfd2-f4b9-4cca-bfb3-2cb384131420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.460905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afcfd2-f4b9-4cca-bfb3-2cb384131420 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.461183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afcfd2-f4b9-4cca-bfb3-2cb384131420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.461505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afcfd2-f4b9-4cca-bfb3-2cb384131420 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/4fd7c6359dee4a4e92f1445249b938a9/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.463585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afcfd2-f4b9-4cca-bfb3-2cb384131420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af16a3c6af664ea2a810122145c3aaa5, user_id=4fd7c6359dee4a4e92f1445249b938a9, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.466437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afcfd2-f4b9-4cca-bfb3-2cb384131420 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.571769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9463-81fa-481c-a883-c06e4e3660f9 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.572057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9463-81fa-481c-a883-c06e4e3660f9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.572250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9463-81fa-481c-a883-c06e4e3660f9 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.574128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 121/248] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:12.580055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07085-9354-4589-8ce5-48e3b7be68b5 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.580536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07085-9354-4589-8ce5-48e3b7be68b5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.581012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07085-9354-4589-8ce5-48e3b7be68b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.581516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 128/249] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:12 2022] PUT /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/4fd7c6359dee4a4e92f1445249b938a9/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:12.587777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae252b-4631-4b0d-8a7c-6810249632d2 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.589354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae252b-4631-4b0d-8a7c-6810249632d2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.589354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae252b-4631-4b0d-8a7c-6810249632d2 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.590271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 129/250] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:12.591421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344b17-c2a8-48d1-9ca0-559d504be968 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.591705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344b17-c2a8-48d1-9ca0-559d504be968 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.591978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344b17-c2a8-48d1-9ca0-559d504be968 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.593786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 130/251] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:12.600816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.601138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.601363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.603924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-fee07085-9354-4589-8ce5-48e3b7be68b5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:12.605188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-fee07085-9354-4589-8ce5-48e3b7be68b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:12.620946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:12.622181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:12.669073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 122/252] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:12.670653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.670653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.670823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.693819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:12.697176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:12.698277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 131/253] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:12.702903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.716576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efec663-6551-4da8-821f-0b5f96def26a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.717607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 123/254] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:12.720349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.722087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.722437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.722716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.726817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.737182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:12.737778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d3bdb-d56c-4496-83b3-86232649b125 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.742718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.743526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.743803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.744073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.746062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:12.747478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 132/255] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:12.751191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.757041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:12.764658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d4086-a077-4a3c-9599-720c00362741 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.767073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:12.769082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.769301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 124/256] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:12.771192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.775093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.775736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.776558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.778424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.780591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.783136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 133/257] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.783762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.790024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77904e-6dee-4da4-a932-9983404731be admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.795477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71dc83-883f-4081-9bd9-412094ac902e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.795667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.796259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.796539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.796749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.797527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:12.797839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.799608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.800613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.801391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.801682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.801940 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.802960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:12.803154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.804788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.809989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 125/258] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.810699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.824606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 134/259] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.824606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.824857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da16e1-c957-4f2b-90d9-895abc921934 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.829459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.830143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.830450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.830723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.831446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.833924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.836809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ef3a-c363-48d9-81a7-32ed94e93194 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.842079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.843004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.843281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.843718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] PATH_INFO: `/v3/users/397a9d35ff8d40098deafbc10ab38395` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.844974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] RBAC: Authorizing `identity:get_user(user_id=397a9d35ff8d40098deafbc10ab38395)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.847191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.849818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 135/260] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/users/397a9d35ff8d40098deafbc10ab38395 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.851454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.861050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f27916-b267-471c-a53b-37d3f3ae88de admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.865719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.866603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.866891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.867154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] PATH_INFO: `/v3/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.881534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.883695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.885451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 136/261] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5 => generated 297 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.887172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.900048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f40c22-c9ba-4229-a85f-c45b5f040936 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.904581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.905299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.905580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.905857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.914554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.916308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.925427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 137/262] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:12.925427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.935396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf500352-cd4d-4abf-a8de-bba6904642f5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.939832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.940456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.940734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.941004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.949814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.951650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.961423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 138/264] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:12.962199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.966055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 126/264] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:12 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:12.967841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:12.973639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e9b76-8621-49dd-9fd0-993c26d07ee9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.979888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.981099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e10be-ccd9-4f45-ae49-09e25b3eb4a1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:12.981425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.981896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.982423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.984031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.986323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:12.987093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.987451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:12.987799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:12.988178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:12.989952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:12.990427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 139/265] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:12.997324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:12.999860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 127/266] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:13.001035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:13.005723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:13.013461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd7d6-3b3e-4ee9-a7e7-b38fd6ce098b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:13.016968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf0523-f3d1-47ef-8007-5bfb416759b7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:13.018696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:13.019564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:13.020700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:13.021246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:13.022344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] RBAC: Adding query filter params (role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=397a9d35ff8d40098deafbc10ab38395) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:13.022850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:13.024090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:13.024932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f60b1-4bd1-48b2-8ef3-51432febce55 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:13.025154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:13.025571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:13.026029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:13.027385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] RBAC: Adding query filter params (role.id=fadeade529264a9ab92847a557dddcd8, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:13.027970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:13.030393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233583c6-cb18-4501-a1bb-7356b45e4c79 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:13.032543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 140/267] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:12 2022] GET /identity/v3/role_assignments?user.id=397a9d35ff8d40098deafbc10ab38395&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:13.039451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 128/268] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:13 2022] GET /identity/v3/role_assignments?user.id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=fadeade529264a9ab92847a557dddcd8 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:15.093760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5acf1-d1c2-498b-8dec-543e4466a57e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.094341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5acf1-d1c2-498b-8dec-543e4466a57e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.094631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5acf1-d1c2-498b-8dec-543e4466a57e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.096652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 141/269] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:15.103841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.104362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.104648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.135910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:15.137428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:15.149072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 129/270] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:15.175857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5acf1-d1c2-498b-8dec-543e4466a57e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.190931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5acf1-d1c2-498b-8dec-543e4466a57e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.196938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.197790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.198069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.198385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.214661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:15.223181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:15.226232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 142/271] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:15.232233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.243585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020a0f1-64f9-444b-9ac6-d2ce1e7b3dca None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.248366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.249056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.249340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.249615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.250508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:15.250819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.252487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.262613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 130/272] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:15.267951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.279653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862fbed-05a3-437e-9bda-e36f60f28e7a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.284142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.285001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.285282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.285569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] PATH_INFO: `/v3/users/4fd7c6359dee4a4e92f1445249b938a9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.287968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] RBAC: Authorizing `identity:get_user(user_id=4fd7c6359dee4a4e92f1445249b938a9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.290137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.292021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 143/273] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/users/4fd7c6359dee4a4e92f1445249b938a9 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:15.297473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.308660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97867c0-d1b2-4049-b1c5-5c162b3957b1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.315322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.315993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.317044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.317370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.329222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.331048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.341945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 131/274] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:15.348120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.360821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee773e9-cf90-4962-aa67-13496b78d659 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.368608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80f5d7-7c71-4652-a095-9a7ba2fddaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.369516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f5d7-7c71-4652-a095-9a7ba2fddaad admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.369801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f5d7-7c71-4652-a095-9a7ba2fddaad admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.370284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80f5d7-7c71-4652-a095-9a7ba2fddaad admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.372248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f5d7-7c71-4652-a095-9a7ba2fddaad admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.374408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80f5d7-7c71-4652-a095-9a7ba2fddaad admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.376311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 144/275] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:15.382712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.391847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e534-2e42-418e-b43c-404badaffe28 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.396884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.397607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.397893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.398171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.399058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=4fd7c6359dee4a4e92f1445249b938a9) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:15.399372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.401264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a053-cb89-4100-a898-064fc71a3561 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.411773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 132/276] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/role_assignments?user.id=4fd7c6359dee4a4e92f1445249b938a9&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=c32977f9cff44544b097a3692528aa7c => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:15.573167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd6ef0-86c0-4f9e-a005-afc3267000b2 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.573489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd6ef0-86c0-4f9e-a005-afc3267000b2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.573724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd6ef0-86c0-4f9e-a005-afc3267000b2 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.575848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 145/277] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:15.581522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926e64-91fe-463c-b803-09769f038546 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.582149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926e64-91fe-463c-b803-09769f038546 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.582655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18926e64-91fe-463c-b803-09769f038546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.603524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-18926e64-91fe-463c-b803-09769f038546 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:15.605134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-18926e64-91fe-463c-b803-09769f038546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:15.616160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 133/278] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:15.638954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd6ef0-86c0-4f9e-a005-afc3267000b2 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.655805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd6ef0-86c0-4f9e-a005-afc3267000b2 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.665802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb443e-6f42-4ddb-bf2c-a056d63944d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.666977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb443e-6f42-4ddb-bf2c-a056d63944d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.667559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb443e-6f42-4ddb-bf2c-a056d63944d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.668024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb443e-6f42-4ddb-bf2c-a056d63944d0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.680523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb443e-6f42-4ddb-bf2c-a056d63944d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:15.687956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-f6bb443e-6f42-4ddb-bf2c-a056d63944d0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:15.689513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 146/279] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:15.696327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926e64-91fe-463c-b803-09769f038546 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.696969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60456a-0e93-461a-acce-d55c1795d6f8 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.697270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60456a-0e93-461a-acce-d55c1795d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.697541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60456a-0e93-461a-acce-d55c1795d6f8 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.699647 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 147/280] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:15.705658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbede54-cd30-4e64-8b66-7d767b1eefdc None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.705963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbede54-cd30-4e64-8b66-7d767b1eefdc None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.706861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbede54-cd30-4e64-8b66-7d767b1eefdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.707597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18926e64-91fe-463c-b803-09769f038546 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.712401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.713359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.713886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.716309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.716309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:15.716309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.717138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e7630-0ffb-4b64-be6f-661d4dc81a17 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.727167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 134/281] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:15.728600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927eb6-f178-4ada-a359-31a52c9fa3f5 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.728886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927eb6-f178-4ada-a359-31a52c9fa3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.729154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2927eb6-f178-4ada-a359-31a52c9fa3f5 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.729533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5bbede54-cd30-4e64-8b66-7d767b1eefdc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:15.730728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5bbede54-cd30-4e64-8b66-7d767b1eefdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:15.730889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 135/282] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:15.733947 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927eb6-f178-4ada-a359-31a52c9fa3f5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.741424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 148/283] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:15.742917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.743203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.743477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.751413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2927eb6-f178-4ada-a359-31a52c9fa3f5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.758532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.761573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.761856 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.763119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] PATH_INFO: `/v3/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.763661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] RBAC: Authorizing `identity:get_user(user_id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.765851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.768067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 136/284] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5 => generated 297 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:15.768838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.770362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:15.771973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:15.779854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8444759-6c93-4f07-9a99-d87ceac42161 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.781803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 149/285] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:15.782637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.790529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.791313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.791591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.792220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.793834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac85107-a16c-477f-8f82-33fd31946145 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.799146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.800006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.800522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.800522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.802477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.803974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:15.804792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.806797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 150/286] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:15.811150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:15.811619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.812357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 137/287] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:15.817115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.822607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bff251-6bf4-4412-a7c5-fe13a38322ee admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.824840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800387e3-6241-4b9a-ac38-0b512edeba2f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.827116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.827892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.828168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.828440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.829587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.829933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.830835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.831111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.831358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.831472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5/roles/fadeade529264a9ab92847a557dddcd8` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.832877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 151/288] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:15.834161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.838920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=af16a3c6af664ea2a810122145c3aaa5, user_id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5, role_id=fadeade529264a9ab92847a557dddcd8)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.841586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.844927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a58fc-c291-40b7-bade-6d149639d1d5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.850236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.850914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.851196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.851470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.852224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:15.852528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.854154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.862934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 152/289] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:15.863720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:15.873719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ce37-664b-4bbb-9deb-795dbf461ded admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:15.878225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8cc17-6b6d-4006-a953-635bca796d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:15.878878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cc17-6b6d-4006-a953-635bca796d50 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:15.879164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cc17-6b6d-4006-a953-635bca796d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:15.879442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cc17-6b6d-4006-a953-635bca796d50 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:15.880746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8cc17-6b6d-4006-a953-635bca796d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:15.882689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8cc17-6b6d-4006-a953-635bca796d50 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:15.931343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 138/290] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:15 2022] PUT /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5/roles/fadeade529264a9ab92847a557dddcd8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:15.932171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:16.001374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b38e-afb9-4d3e-af45-f0ce716a25ce admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:16.007366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:16.008265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:16.008551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:16.008823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] PATH_INFO: `/v3/users/753e340e254347a190b1703e92626cde` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:16.028995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=753e340e254347a190b1703e92626cde)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:16.031359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:16.033136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 139/291] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:15 2022] GET /identity/v3/users/753e340e254347a190b1703e92626cde => generated 293 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:16.040073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:16.045554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 153/292] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:15 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:16.052641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17b806-42d9-4611-810d-a50145d473e2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:16.057830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:16.058559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:16.058844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:16.059175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:16.060259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, user.id=753e340e254347a190b1703e92626cde, scope.system=all) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:16.060572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:16.062665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a478fb-bf93-4658-a808-5f403c8aa03b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:16.072968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 140/293] 10.222.0.20 () {56 vars in 1329 bytes} [Mon Jan 10 11:16:16 2022] GET /identity/v3/role_assignments?user.id=753e340e254347a190b1703e92626cde&scope.system=all&role.id=c32977f9cff44544b097a3692528aa7c => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:18.456280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991773c-1fca-4024-8f14-9f663c6acb96 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.456821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991773c-1fca-4024-8f14-9f663c6acb96 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.456821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991773c-1fca-4024-8f14-9f663c6acb96 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.459224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 154/294] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:18.464968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.465446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.465524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.487911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:18.490064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:18.506723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 141/295] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:18.528882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991773c-1fca-4024-8f14-9f663c6acb96 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.548658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991773c-1fca-4024-8f14-9f663c6acb96 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.555854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317851aa-b5b2-41ef-a645-0c3c85386a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.557301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317851aa-b5b2-41ef-a645-0c3c85386a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.557604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317851aa-b5b2-41ef-a645-0c3c85386a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.557888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317851aa-b5b2-41ef-a645-0c3c85386a8f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.571646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317851aa-b5b2-41ef-a645-0c3c85386a8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:18.578718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-317851aa-b5b2-41ef-a645-0c3c85386a8f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:18.579934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 155/296] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:18.586265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.598371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae45f-1000-4419-98b2-03694e4c6fe2 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.598633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae45f-1000-4419-98b2-03694e4c6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.598913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae45f-1000-4419-98b2-03694e4c6fe2 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.601138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 156/297] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:18.602045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490806e3-9880-4419-b957-d7fb68a9eea6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.606622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.606909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.607190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.608413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.609418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.609958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.610517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.611610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:18.612226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.614090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.627701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 142/298] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:18.634340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.643787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:18.645454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:18.648855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497e6e7-73bb-4fa6-ac78-d204138bfac9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.653938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.654943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.655229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 157/299] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:18.655565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.655856 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] PATH_INFO: `/v3/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.662979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] RBAC: Authorizing `identity:get_user(user_id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.666940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.668747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 143/300] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/users/b0a6c1f45f5949b9a2e6bedf7f2a5ea5 => generated 297 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:18.674598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.680341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.686416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f2b27-9616-427b-b80d-ce40d7d86efc None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.691021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.691808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.692189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.692565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.692871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47da14-3b3d-44c5-927d-886e8cc6d25b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.698176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.699413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.700422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.700883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.702797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.704684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.714607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:18.715855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 158/301] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:18.723222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.725810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:18.727460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 144/302] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:18.733084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.735395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ec462-8289-4597-8bf5-a6ff56476a42 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.740731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.741778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.742256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.742677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.744110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.745275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c7a77-4957-4726-be12-f32a83fca8c8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.746731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.750490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 159/303] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:18.757185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.758549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.759284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.759567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.759841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.760612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:18.760921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.762601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.770184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dde73-66b6-48ba-af47-f16f48c59784 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.778008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 145/304] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:18.779361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.782932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.783842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.784325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.784792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.785820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] RBAC: Adding query filter params (role.id=fadeade529264a9ab92847a557dddcd8, scope.project.id=af16a3c6af664ea2a810122145c3aaa5, user.id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:18.786430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.788622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe3c22-8fa0-4191-a85d-cbcf611ece76 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.790339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536648-31da-4d75-b607-d578967b5c46 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.796121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ecf5f-f0f3-41e1-925e-9525ef8f27fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.797305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ecf5f-f0f3-41e1-925e-9525ef8f27fa admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.797782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ecf5f-f0f3-41e1-925e-9525ef8f27fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.798245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ecf5f-f0f3-41e1-925e-9525ef8f27fa admin admin] PATH_INFO: `/v3/users/753e340e254347a190b1703e92626cde` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.802194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 160/305] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/role_assignments?user.id=b0a6c1f45f5949b9a2e6bedf7f2a5ea5&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=fadeade529264a9ab92847a557dddcd8 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:18.803886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ecf5f-f0f3-41e1-925e-9525ef8f27fa admin admin] RBAC: Authorizing `identity:get_user(user_id=753e340e254347a190b1703e92626cde)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.806504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ecf5f-f0f3-41e1-925e-9525ef8f27fa admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.806724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62161-0533-4276-b6fe-150711c68238 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.807137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62161-0533-4276-b6fe-150711c68238 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.807482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62161-0533-4276-b6fe-150711c68238 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.809076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 146/306] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/users/753e340e254347a190b1703e92626cde => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:18.809933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 161/307] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:18.818649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62161-0533-4276-b6fe-150711c68238 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.820089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82b55-a139-468f-8bc1-0aa6dccc44cf None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.820089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82b55-a139-468f-8bc1-0aa6dccc44cf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.820089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d82b55-a139-468f-8bc1-0aa6dccc44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.832083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62161-0533-4276-b6fe-150711c68238 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.840630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.841791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.842093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-06d82b55-a139-468f-8bc1-0aa6dccc44cf None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:18.842521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.843136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] PATH_INFO: `/v3/system/users/753e340e254347a190b1703e92626cde/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.843361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-06d82b55-a139-468f-8bc1-0aa6dccc44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:18.845318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=753e340e254347a190b1703e92626cde, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.846602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:18.846602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:18.846602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:18.848386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.851504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 147/308] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:18.865667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36659f35-c944-47b6-8a74-13d9c03f36e1 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.865953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36659f35-c944-47b6-8a74-13d9c03f36e1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.866240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36659f35-c944-47b6-8a74-13d9c03f36e1 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.868293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 148/309] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:18.873889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.874182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.874650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.894670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:18.895890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:18.904163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 149/310] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:18.906206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.916793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678b02b-22cb-4cf8-8689-5b5170e3ce88 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.921322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.922133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.922606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.922708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.942752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 162/311] 10.222.0.20 () {58 vars in 1355 bytes} [Mon Jan 10 11:16:18 2022] PUT /identity/v3/system/users/753e340e254347a190b1703e92626cde/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:18.943597 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.946656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:18.954245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:18.961906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 150/312] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:18.963677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.966870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a567ef-3ba2-4dfa-bc99-ef41e705c10f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.972132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.973149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.973499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.973913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:18.977473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:18.979955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:18.982037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 163/313] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:18.983092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82140694-6120-475a-baaf-abbf1d73ce05 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:18.988112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:18.992329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:18.993158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:18.993530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:18.993873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:19.000186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1b2d-8f53-4498-b1b9-0c7f103796dc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:19.001130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:19.001631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:19.003926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:19.005189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:19.006504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:19.006782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:19.007062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] PATH_INFO: `/v3/groups` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:19.008380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:19.009560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:19.009560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:19.009560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:19.010948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b37f24-2d89-4289-a632-6b9c3f9cb2c2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:19.022166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 151/314] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:19.023416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:19.034742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c143fa-f7e6-4c5d-be86-dc2226ddc84e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:19.040807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:19.041829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:19.042187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:19.042569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] PATH_INFO: `/v3/users/637a0f4b1cea47d48127547a4d55ffcf` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:19.060455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] RBAC: Authorizing `identity:get_user(user_id=637a0f4b1cea47d48127547a4d55ffcf)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:19.062915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:19.064780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 152/315] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:19 2022] GET /identity/v3/users/637a0f4b1cea47d48127547a4d55ffcf => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:19.072618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:19.082758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613c1f5-49a6-40c2-9efd-bc0dd079098e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:19.087740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:19.088412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:19.088807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:19.088989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:19.089805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] RBAC: Adding query filter params (role.id=fadeade529264a9ab92847a557dddcd8, user.id=637a0f4b1cea47d48127547a4d55ffcf, scope.system=all) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:19.090128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:19.092075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a59ac4-8ba4-4521-9943-1686af5cf0d7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:19.093745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 164/316] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jan 10 11:16:18 2022] POST /identity/v3/groups => generated 229 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:16:19.098778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 153/317] 10.222.0.20 () {56 vars in 1329 bytes} [Mon Jan 10 11:16:19 2022] GET /identity/v3/role_assignments?user.id=637a0f4b1cea47d48127547a4d55ffcf&scope.system=all&role.id=fadeade529264a9ab92847a557dddcd8 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:21.425715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3d3e-f2fd-42e6-94c8-536427831db9 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.426447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3d3e-f2fd-42e6-94c8-536427831db9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.426447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3d3e-f2fd-42e6-94c8-536427831db9 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.428112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 165/318] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:21.433482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.433904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.434077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.452664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:21.453834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:21.461833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 154/319] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:21.486934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3d3e-f2fd-42e6-94c8-536427831db9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.499635 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3d3e-f2fd-42e6-94c8-536427831db9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.507901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab08321-f186-4eea-964a-3d05d88aceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.508691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab08321-f186-4eea-964a-3d05d88aceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.508966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab08321-f186-4eea-964a-3d05d88aceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.509234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab08321-f186-4eea-964a-3d05d88aceb6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.520929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab08321-f186-4eea-964a-3d05d88aceb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:21.528902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0ab08321-f186-4eea-964a-3d05d88aceb6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:21.530346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 166/320] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:21.535766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.544755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4878b04-c35c-4662-9ec2-fa9d1c90e1a5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.549006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.549661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.549932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.550195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.551318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:21.551617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.552445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eb9bf-e7bb-430a-8b35-d5a0d2ad6bba None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.552736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eb9bf-e7bb-430a-8b35-d5a0d2ad6bba None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.553533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eb9bf-e7bb-430a-8b35-d5a0d2ad6bba None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.554130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828e31-fb89-415a-954e-843770279fe8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.556373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 167/321] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:21.561459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de26c-e333-4322-ae2f-ed6ae9e1f3e1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.561745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de26c-e333-4322-ae2f-ed6ae9e1f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.562024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24de26c-e333-4322-ae2f-ed6ae9e1f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.565146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 155/322] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:21.566843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea2aa-5d8f-4a3c-bf06-d35a80a4cd8b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.567158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea2aa-5d8f-4a3c-bf06-d35a80a4cd8b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.567434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ea2aa-5d8f-4a3c-bf06-d35a80a4cd8b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.569881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 156/323] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:21.571185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ea2aa-5d8f-4a3c-bf06-d35a80a4cd8b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.581872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f24de26c-e333-4322-ae2f-ed6ae9e1f3e1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:21.582694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ea2aa-5d8f-4a3c-bf06-d35a80a4cd8b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.583139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f24de26c-e333-4322-ae2f-ed6ae9e1f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:21.587099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.587938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.588212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.588478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] PATH_INFO: `/v3/users/753e340e254347a190b1703e92626cde` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.589656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] RBAC: Authorizing `identity:get_user(user_id=753e340e254347a190b1703e92626cde)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.591703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 168/324] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:21.591824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.592945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.593286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.593507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.597874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 157/325] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/users/753e340e254347a190b1703e92626cde => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:21.599079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.608688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73c30-6f16-41ad-9066-3e03a8e07ab9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.611837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:21.613005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:21.613318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.614392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.614517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.614884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.616358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] RBAC: Adding query filter params (role.id=c32977f9cff44544b097a3692528aa7c, user.id=753e340e254347a190b1703e92626cde, scope.system=all) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:21.616903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.618882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.621618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 169/326] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:21.622439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.632763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5350c-3fd4-4ad6-b21a-fdbfa4a1e0d0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.635857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 158/327] 10.222.0.20 () {56 vars in 1329 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/role_assignments?user.id=753e340e254347a190b1703e92626cde&scope.system=all&role.id=c32977f9cff44544b097a3692528aa7c => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:21.639828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.640787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.641139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.641480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.647195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.655028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:21.658908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd67b7-6445-4339-8107-bbd4e62536bb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.662469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:21.663644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.664749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.664861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 170/328] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:21.664949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.665049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.666554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.668411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.674277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 159/329] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:21.674510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.676397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.682414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc6fe6-db46-4ba5-bb59-318854d8c093 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.687734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24679-011a-481f-99f3-91c10d5fcb34 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.688280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.689033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.689391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.689739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.690621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:21.691003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.692636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.692805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.693460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.693893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.694266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] PATH_INFO: `/v3/groups` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.695449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.697040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:21.697040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:21.697040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:21.698443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4af36f-0765-48ba-a97a-c442a53805fb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.704747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 171/330] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:21.711303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.721380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7607d7-3175-483c-8827-5aacb7201443 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.727369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.728328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.728621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.728894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] PATH_INFO: `/v3/users/637a0f4b1cea47d48127547a4d55ffcf` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.730284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] RBAC: Authorizing `identity:get_user(user_id=637a0f4b1cea47d48127547a4d55ffcf)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.732465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.734188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 172/331] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:21 2022] GET /identity/v3/users/637a0f4b1cea47d48127547a4d55ffcf => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:21.740060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:21.751331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d729896-c87c-4f32-9cac-49db7b05201e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:21.755741 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233cc5b-41c7-435f-a312-6f9f4af9a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:21.757291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cc5b-41c7-435f-a312-6f9f4af9a4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:21.757572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cc5b-41c7-435f-a312-6f9f4af9a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:21.757844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233cc5b-41c7-435f-a312-6f9f4af9a4c9 admin admin] PATH_INFO: `/v3/system/users/637a0f4b1cea47d48127547a4d55ffcf/roles/fadeade529264a9ab92847a557dddcd8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:21.759416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cc5b-41c7-435f-a312-6f9f4af9a4c9 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=637a0f4b1cea47d48127547a4d55ffcf, role_id=fadeade529264a9ab92847a557dddcd8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:21.761027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233cc5b-41c7-435f-a312-6f9f4af9a4c9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:21.799645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 160/332] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jan 10 11:16:21 2022] POST /identity/v3/groups => generated 226 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:16:21.865462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 173/333] 10.222.0.20 () {58 vars in 1355 bytes} [Mon Jan 10 11:16:21 2022] PUT /identity/v3/system/users/637a0f4b1cea47d48127547a4d55ffcf/roles/fadeade529264a9ab92847a557dddcd8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:24.999673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13997e23-271b-43f7-8f4c-5a5a30ee22f7 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.000191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13997e23-271b-43f7-8f4c-5a5a30ee22f7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.000191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13997e23-271b-43f7-8f4c-5a5a30ee22f7 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.002246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 161/334] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:25.031272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6679-7a68-41ab-8007-c0ff6ea4258e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.031777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6679-7a68-41ab-8007-c0ff6ea4258e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.031852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6679-7a68-41ab-8007-c0ff6ea4258e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.059225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-414d6679-7a68-41ab-8007-c0ff6ea4258e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:25.060439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-414d6679-7a68-41ab-8007-c0ff6ea4258e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:25.068828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 174/335] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:25.091373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9bf2-3729-4421-8afe-c9682d0a6a95 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.091678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9bf2-3729-4421-8afe-c9682d0a6a95 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.091932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9bf2-3729-4421-8afe-c9682d0a6a95 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.093687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 162/336] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:25.099829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.100149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.100476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.106646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9bf2-3729-4421-8afe-c9682d0a6a95 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.127284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:25.127828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9bf2-3729-4421-8afe-c9682d0a6a95 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.128604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:25.136134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.136937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.137214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.137488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.140729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 175/337] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:25.159141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:25.168161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:25.169406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 163/338] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:25.175224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.185908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.189803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b229-df92-4934-b550-97a4d19fa964 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.199256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.199641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19192321-eced-49cc-9c9e-9038ba763b6e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.199929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.200211 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.200535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.201257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.201566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.203199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.215572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.216382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.216661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.216938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.217585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 176/339] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.222644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.238893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:25.248759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041815e6-efc0-4a55-b3a1-a6e4703bf6bf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.251992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 11:16:25.253427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 164/340] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:25.262289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d593fde-9a82-4038-9b34-1ba535a78290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.262974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593fde-9a82-4038-9b34-1ba535a78290 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.263261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593fde-9a82-4038-9b34-1ba535a78290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.263538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593fde-9a82-4038-9b34-1ba535a78290 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.263806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.274871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d593fde-9a82-4038-9b34-1ba535a78290 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.276656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d593fde-9a82-4038-9b34-1ba535a78290 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.276938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664e2fa-2f93-46ed-97fa-03222003e2b4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.282074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.287670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.288848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.289335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.290476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.291015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.292847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bd782-d798-466f-aaac-a2d16c0a3487 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.296729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 177/341] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:16:25.298136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6d98-0d12-4a55-9960-23e1a67d9c3d None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.298459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6d98-0d12-4a55-9960-23e1a67d9c3d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.298735 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6d98-0d12-4a55-9960-23e1a67d9c3d None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.300513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 178/342] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:25.305288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 165/343] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:25.309531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6d98-0d12-4a55-9960-23e1a67d9c3d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.311365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.311890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.312465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.334274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:25.335907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:25.344642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 166/344] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:25.345879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.350230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6d98-0d12-4a55-9960-23e1a67d9c3d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.360409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89684edd-d6e8-4da6-86e7-d67ed3d09a9e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.365325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.370253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.370253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.370253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.370253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.371085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.371602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.371917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.372279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] PATH_INFO: `/v3/users/637a0f4b1cea47d48127547a4d55ffcf` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.373771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] RBAC: Authorizing `identity:get_user(user_id=637a0f4b1cea47d48127547a4d55ffcf)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.375544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.376371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.378275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 167/346] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/users/637a0f4b1cea47d48127547a4d55ffcf => generated 293 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.382322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 179/346] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.383773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.384478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.399205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa89dc-b2fa-4eb4-bac5-866aeaf8dcbf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.405058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.406163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.406818 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.407294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.408658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e32b8-2910-4eb0-8dd5-b026d0d8c1fc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.419206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.420600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:25.420600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:25.420600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:25.422171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.424108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 168/347] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.430662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.431079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.431329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.431614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.431890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.432847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] RBAC: Adding query filter params (role.id=fadeade529264a9ab92847a557dddcd8, user.id=637a0f4b1cea47d48127547a4d55ffcf, scope.system=all) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.433168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.435064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a89e9a-5f5c-4a4d-a89d-c86710f67119 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.443121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da51fd-0a3b-4da6-aee8-13ea30caeb07 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.449508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.450632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.451120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.451608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.452814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=c3bf921f7c464742a0bf047e27abb27e) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.453362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.455464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.463313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 169/348] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:25.464734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.466928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 180/349] 10.222.0.20 () {56 vars in 1329 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/role_assignments?user.id=637a0f4b1cea47d48127547a4d55ffcf&scope.system=all&role.id=fadeade529264a9ab92847a557dddcd8 => generated 510 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:25.470595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f867750-a269-4951-8d19-366fdef03401 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.470904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f867750-a269-4951-8d19-366fdef03401 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.471149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f867750-a269-4951-8d19-366fdef03401 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.476321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 181/350] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:25.479022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db658-b93d-4b00-89a1-76284ad40bd7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.479440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.479725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.480001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.484679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.485898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.486481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.486977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.501083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:25.510122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:25.511816 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 170/351] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:25.519183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.536837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1a919-0f3e-4325-a523-5007ce472c40 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.538165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:25.539405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:25.542869 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.543866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.544368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.544836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.550238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.551284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.553948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.568920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 171/352] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.575314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.575771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 182/353] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:25.585788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195c7f6-7dbe-40de-89e1-cdbadc066de6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.599169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.599856 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.600146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.600423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.612750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.615181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.628242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 172/354] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:16:25.634716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.634879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.648406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe57c31-938f-43b4-a323-871908399e16 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.656944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fc851-afa2-4c84-bce5-adbb282677af None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.663671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.664566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.664829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.665104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.671210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.672226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.673035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.673314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.673416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.673581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.675437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 173/355] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:25.681774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.696267 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81790-767c-4bdf-930c-5bed6ff0eb9f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.703388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:25.710555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:25.711792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.712618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.712896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.713171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.718771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 183/356] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:25.719234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.721196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.723069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 174/357] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:25.729482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.729757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.747604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466aafe-2461-492f-a5d1-7588ffdb651c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.748068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422f3b1-de98-4cb5-8297-bc6a6fbbfc08 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.765164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.765491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.765747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.765906 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.766071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.766247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.766397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.766537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.767062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.767221 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=c3bf921f7c464742a0bf047e27abb27e) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.767379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.767520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.768959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.769443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.784654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 175/358] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=c32977f9cff44544b097a3692528aa7c => generated 260 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.785266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 184/359] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.791599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.808276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885a1c-e016-4860-a920-2de7f4699417 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.819554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.820277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.820566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.820841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.835525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.837323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.852043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 176/360] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:25.857821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.880420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dcd0b-61ba-44bb-9a9f-a0bd985ce61d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.890795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.891691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.891968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.892237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.899301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.901501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.903704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 185/361] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.909425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.923498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2696ce-f0f9-469c-9cd0-881782d57299 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.930801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c02a82-1980-425c-8ce9-d49860df050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.931692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02a82-1980-425c-8ce9-d49860df050b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.931975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02a82-1980-425c-8ce9-d49860df050b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.932252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c02a82-1980-425c-8ce9-d49860df050b admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.934589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c02a82-1980-425c-8ce9-d49860df050b admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.936806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c02a82-1980-425c-8ce9-d49860df050b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.943271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 177/362] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:25.949694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:25.964674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c8ab9-1d38-4bdc-8368-2fd3ee3b9648 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:25.976945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:25.977612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:25.977889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:25.978160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:25.979032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=af16a3c6af664ea2a810122145c3aaa5) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:25.979339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:25.981193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958a15a-d22e-4a97-80e6-67d57bcc0099 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:25.990408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 186/363] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:25 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=c32977f9cff44544b097a3692528aa7c => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:26.584877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003f6b1-e726-416a-8056-6f5985697675 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.585421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003f6b1-e726-416a-8056-6f5985697675 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.585421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003f6b1-e726-416a-8056-6f5985697675 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.587510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 178/364] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:26.592648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.593052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.593236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.619200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:26.620383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:26.628403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 187/365] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:26.671737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003f6b1-e726-416a-8056-6f5985697675 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:26.688739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003f6b1-e726-416a-8056-6f5985697675 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:26.698084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:26.698922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.699204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.699524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.715971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:26.724190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:26.725769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 179/366] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:26.731493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:26.745378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a297c3f-d443-4558-8dcf-88d96fa1b620 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:26.753178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:26.753861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.754188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.754536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.755259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:26.755557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:26.757176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:26.773674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 188/367] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:26.779518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:26.792654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ed84-110f-449e-9ae3-61e61b343bd0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:26.799383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:26.800555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.801493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.801781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.814023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:26.815953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:26.832526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 180/368] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:26.838926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:26.856301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0741c5-b873-4613-9395-dd29a80e7b85 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:26.864220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:26.865090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.865368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.865636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.868957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:26.871079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:26.873129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 189/369] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:26 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:26.878825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:26.891784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613f204-7b7b-4994-be11-974e002ebb2a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:26.899744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbba19-7660-4b70-a14e-7622e21b0beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:26.901004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbba19-7660-4b70-a14e-7622e21b0beb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.901599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbba19-7660-4b70-a14e-7622e21b0beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.901873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbba19-7660-4b70-a14e-7622e21b0beb admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.907042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbba19-7660-4b70-a14e-7622e21b0beb admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:26.909111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbba19-7660-4b70-a14e-7622e21b0beb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:26.911380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 181/370] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:26 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:26.917339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:26.931867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a0881-d839-464d-bdfb-9668eafcb8be admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:26.943387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:26.944042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:26.944325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:26.944595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:26.945453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=af16a3c6af664ea2a810122145c3aaa5) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:26.945757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:26.947641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ee4d9-173a-42ee-b469-16706b91ead7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:26.958862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 190/371] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:26 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:27.002637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850b72c-e520-4bb6-8182-260d99d809cc None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.002972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850b72c-e520-4bb6-8182-260d99d809cc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.003252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850b72c-e520-4bb6-8182-260d99d809cc None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.005583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 182/372] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:27.013250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.013250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.013250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.042574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:27.044140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:27.057341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 191/373] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:27.101687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850b72c-e520-4bb6-8182-260d99d809cc None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:27.120880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850b72c-e520-4bb6-8182-260d99d809cc None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:27.126559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:27.127422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.127706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.127980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.142296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:27.150639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:27.152482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 183/374] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:27.158100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:27.172702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd03ae8-f2e6-49bd-8dbc-217e90c63505 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:27.182595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:27.183667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.184170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.184649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.185650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:27.186169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:27.188056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:27.202910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 192/375] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:27.208965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:27.224431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed645d-6de2-410a-b7b2-477d01c43043 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:27.234587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:27.235502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.235782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.236062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.251831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:27.253890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:27.268765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 184/376] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:27.274853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:27.291404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab5140-2768-4428-b5c9-5aaf18021930 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:27.298119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:27.299013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.299291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.299558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.302955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:27.304766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:27.306821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 193/377] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:27 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:27.311821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:27.321188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2374fa-baa6-40cc-a9eb-55093508a153 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:27.329108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894a61b-8e99-4cd3-80c7-8b5c317721c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:27.329967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894a61b-8e99-4cd3-80c7-8b5c317721c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.330311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894a61b-8e99-4cd3-80c7-8b5c317721c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.330588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894a61b-8e99-4cd3-80c7-8b5c317721c1 admin admin] PATH_INFO: `/v3/groups/5ef7762c7c634ac49c5dc45cf06096bb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.336104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894a61b-8e99-4cd3-80c7-8b5c317721c1 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ef7762c7c634ac49c5dc45cf06096bb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:27.338018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894a61b-8e99-4cd3-80c7-8b5c317721c1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:27.339698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 185/378] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:27 2022] GET /identity/v3/groups/5ef7762c7c634ac49c5dc45cf06096bb => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:27.345532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:27.356968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1d5ba-0820-41b7-95f3-6471ce01b366 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:27.362460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:27.363772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:27.364144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:27.364413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:27.365252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] RBAC: Adding query filter params (group.id=5ef7762c7c634ac49c5dc45cf06096bb, role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=fd70255155e6410bb2d9f4554d34cff0) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:27.365557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:27.367450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239db479-4978-44f4-8bc0-5176fb51df68 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:27.375410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 194/379] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:27 2022] GET /identity/v3/role_assignments?group.id=5ef7762c7c634ac49c5dc45cf06096bb&scope.project.id=fd70255155e6410bb2d9f4554d34cff0&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:28.935256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab1a6-7cf8-415b-98a1-ed603c960a5b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:28.935256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab1a6-7cf8-415b-98a1-ed603c960a5b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:28.935256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab1a6-7cf8-415b-98a1-ed603c960a5b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:28.935256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 186/380] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:28.940693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:28.941561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:28.942031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:28.967200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:28.968738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:28.977564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 195/381] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:29.022315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab1a6-7cf8-415b-98a1-ed603c960a5b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.040255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab1a6-7cf8-415b-98a1-ed603c960a5b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.047378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.048454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.049325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.049814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.066508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:29.074925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:29.076364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 187/382] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:29.083095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.092594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a732ce-c17d-471b-bdab-154e2b01b119 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.100935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.101898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.102405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.102882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.103857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:29.104359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.106145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.115937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 196/383] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:29.121871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.132846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255372c-76de-4d7d-9248-8b0cf76d5eaf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.140832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38618219-a45b-44b5-bc8e-dfcb8f01db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.141987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38618219-a45b-44b5-bc8e-dfcb8f01db49 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.143081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38618219-a45b-44b5-bc8e-dfcb8f01db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.143552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38618219-a45b-44b5-bc8e-dfcb8f01db49 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.145016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38618219-a45b-44b5-bc8e-dfcb8f01db49 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.147236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38618219-a45b-44b5-bc8e-dfcb8f01db49 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.149097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 188/384] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:29.155194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.165406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f304a-843b-4090-b6cb-27d20d5d3d63 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.174770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43280db6-1d6f-4d85-8b5f-fb354897c468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.175908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43280db6-1d6f-4d85-8b5f-fb354897c468 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.176391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43280db6-1d6f-4d85-8b5f-fb354897c468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.176862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43280db6-1d6f-4d85-8b5f-fb354897c468 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.178327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43280db6-1d6f-4d85-8b5f-fb354897c468 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.180679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43280db6-1d6f-4d85-8b5f-fb354897c468 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.183788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 197/385] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:29.185572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7548-efbb-4421-bc69-a75ddbbb6924 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.186065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7548-efbb-4421-bc69-a75ddbbb6924 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.186547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be7548-efbb-4421-bc69-a75ddbbb6924 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.188483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 189/386] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:29.194021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.194556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.195021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.197656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7548-efbb-4421-bc69-a75ddbbb6924 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.215862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be7548-efbb-4421-bc69-a75ddbbb6924 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.220322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.222015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.222619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.223117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.225712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf921f7c464742a0bf047e27abb27e, group_id=ac0105a5b2db4c68aa47b0ec517830a7, role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.229343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.231225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:29.232441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:29.242249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 198/387] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:29.268163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.277900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f6f8-97d2-412f-921e-94dec158ff6e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.283359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078903-006f-43ae-8354-f2629da2aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.284233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078903-006f-43ae-8354-f2629da2aada admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.284508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078903-006f-43ae-8354-f2629da2aada admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.284780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078903-006f-43ae-8354-f2629da2aada admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.295424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078903-006f-43ae-8354-f2629da2aada admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:29.303210 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-44078903-006f-43ae-8354-f2629da2aada admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:29.304718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 199/388] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:29.305953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8f4a-58ad-4315-b352-7a6e979d0a6c None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.306247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8f4a-58ad-4315-b352-7a6e979d0a6c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.306523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa8f4a-58ad-4315-b352-7a6e979d0a6c None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.308307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 200/389] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:29.311293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa8f4a-58ad-4315-b352-7a6e979d0a6c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.326062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa8f4a-58ad-4315-b352-7a6e979d0a6c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.331462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.332474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.332996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.333527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.334615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:29.335125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.337039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b50f82-7bb7-4370-acaa-225b5c8cb121 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.347869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 201/390] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:29.349523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.350016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.354374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.379412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:29.380623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:29.389479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 190/391] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Jan 10 11:16:29 2022] PUT /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:16:29.390156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.448891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 202/392] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:29.491457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.505851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c34709-5157-436f-890b-6f12a867ac63 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.519924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476f98-1ff7-49e0-ab86-3e0fbd086792 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.526322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.527135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.527349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.527471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.527670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.528953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.529437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.530232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.531712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.535083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.537380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 191/393] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:29.543107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.557009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:29.568375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff196733-66f4-4da6-be45-8b9739498084 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.569547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:29.571410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 203/394] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:29.576335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.577510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.583291 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.583589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.583883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.585517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.594324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.594324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 192/395] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:29.596697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.597360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a3bd-ecaf-4b7d-b6e0-e6f68692176b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.615009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82e495-5174-4675-a52d-5f0975600e9c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.615950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.616736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.617020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.617454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.619593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:29.619593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.620356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.623880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0638e-3ca7-4228-b1fc-4392972c841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.625115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0638e-3ca7-4228-b1fc-4392972c841c admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.625625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0638e-3ca7-4228-b1fc-4392972c841c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.626116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0638e-3ca7-4228-b1fc-4392972c841c admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.629229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0638e-3ca7-4228-b1fc-4392972c841c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf921f7c464742a0bf047e27abb27e, group_id=ac0105a5b2db4c68aa47b0ec517830a7, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.632415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0638e-3ca7-4228-b1fc-4392972c841c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.638301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 204/396] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:29.640879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.653545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221a831-caec-4c36-8100-e5ce53d22e3b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.659792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.661221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.663083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.663609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.665421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.666842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:29.666842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:29.666842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:29.668669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.670850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 205/397] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:29.676824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.688747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f3a3c-610f-42f0-b76a-aa0a5ffb92ef admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.695434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.697030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.697812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.698363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.705062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.705062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.706563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 206/398] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:29 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:29.713087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:29.726135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb9b34-3a11-4c72-933b-9d11b4bfab7f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:29.731170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6566a8-02c0-4029-8b50-5567f65128d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:29.732140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6566a8-02c0-4029-8b50-5567f65128d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:29.732423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6566a8-02c0-4029-8b50-5567f65128d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:29.732692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6566a8-02c0-4029-8b50-5567f65128d7 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:29.736519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6566a8-02c0-4029-8b50-5567f65128d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af16a3c6af664ea2a810122145c3aaa5, group_id=ac0105a5b2db4c68aa47b0ec517830a7, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:29.739240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6566a8-02c0-4029-8b50-5567f65128d7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:29.745502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 193/399] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Jan 10 11:16:29 2022] PUT /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:16:29.874458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 207/400] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Jan 10 11:16:29 2022] PUT /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:30.171231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35570-4d9a-4ef3-a4be-46c4ac208de5 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.171787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35570-4d9a-4ef3-a4be-46c4ac208de5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.171787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35570-4d9a-4ef3-a4be-46c4ac208de5 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.174167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 194/401] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:30.180183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.180687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.180786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.203720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:30.205029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:30.272502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 208/402] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:30.299982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35570-4d9a-4ef3-a4be-46c4ac208de5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:30.317499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35570-4d9a-4ef3-a4be-46c4ac208de5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:30.325892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:30.326809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.327087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.327355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.341926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:30.350198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:30.351511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 195/403] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:30.357414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:30.373801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e5a5-6bc9-4932-b6a0-c5710d7821a9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:30.382430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:30.383104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.383383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.383659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.384424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:30.384717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:30.386340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:30.404379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 209/404] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:30.410519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:30.424473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0f431-53cc-4c85-8d42-3bc717c71272 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:30.430366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:30.431282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.431560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.431833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.435067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:30.437065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:30.439370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 196/405] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:30 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:30.445079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:30.460278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb0000-ffdc-4d80-9d21-9619eb631085 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:30.471493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c912e89-b87b-4b98-8bf9-a8b149a9d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:30.472368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912e89-b87b-4b98-8bf9-a8b149a9d28e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.472649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912e89-b87b-4b98-8bf9-a8b149a9d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.472923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912e89-b87b-4b98-8bf9-a8b149a9d28e admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.474204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c912e89-b87b-4b98-8bf9-a8b149a9d28e admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:30.476315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c912e89-b87b-4b98-8bf9-a8b149a9d28e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:30.478372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 210/406] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:30 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:30.485238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:30.498168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273049e5-db33-49c6-af57-c8bb2538e35d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:30.506445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de870bd-4758-4327-a3ab-902d11fd1c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:30.507381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de870bd-4758-4327-a3ab-902d11fd1c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:30.507660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de870bd-4758-4327-a3ab-902d11fd1c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:30.507930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de870bd-4758-4327-a3ab-902d11fd1c9f admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:30.516440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de870bd-4758-4327-a3ab-902d11fd1c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af16a3c6af664ea2a810122145c3aaa5, group_id=ac0105a5b2db4c68aa47b0ec517830a7, role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:30.519427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de870bd-4758-4327-a3ab-902d11fd1c9f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:30.613311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 197/407] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Jan 10 11:16:30 2022] PUT /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5/groups/ac0105a5b2db4c68aa47b0ec517830a7/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:31.269672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96d7c5-4367-4808-8407-3951a7230736 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.270179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96d7c5-4367-4808-8407-3951a7230736 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.270304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96d7c5-4367-4808-8407-3951a7230736 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.272317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 211/408] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:31.277897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.278371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.278461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.303293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:31.304512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:31.393584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 198/409] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:31.431723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96d7c5-4367-4808-8407-3951a7230736 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:31.455947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96d7c5-4367-4808-8407-3951a7230736 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:31.463663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:31.464446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.464721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.464990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.476847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:31.488028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:31.494370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 212/410] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:31.495958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:31.517004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf5188-69bb-4cb9-b468-0d8c045791ca None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:31.531015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:31.532229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.532530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.532772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.533552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:31.533852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:31.535518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:31.549908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 199/411] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:31.555397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:31.568138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5190bb-2d38-45f2-be37-d8b8587469ef admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:31.580405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:31.582135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.582507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.582780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] PATH_INFO: `/v3/groups/5ef7762c7c634ac49c5dc45cf06096bb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.584050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] RBAC: Authorizing `identity:get_group(group_id=5ef7762c7c634ac49c5dc45cf06096bb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:31.586066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:31.592152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 213/412] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:31 2022] GET /identity/v3/groups/5ef7762c7c634ac49c5dc45cf06096bb => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:31.593563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:31.611361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272a054-8bd4-4bef-a63f-4a642f265345 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:31.618721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84ab0b-e0bb-42e5-b552-151cf1bcdc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:31.619576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ab0b-e0bb-42e5-b552-151cf1bcdc8c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.619853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ab0b-e0bb-42e5-b552-151cf1bcdc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.620123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ab0b-e0bb-42e5-b552-151cf1bcdc8c admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.627014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84ab0b-e0bb-42e5-b552-151cf1bcdc8c admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:31.628829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84ab0b-e0bb-42e5-b552-151cf1bcdc8c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:31.630910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 200/413] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:31 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:31.636891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:31.648711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4c3e-c410-4112-9ad0-1a1659794bcd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:31.659366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048458f-57d1-4828-b9e3-f93ab287b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:31.660297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048458f-57d1-4828-b9e3-f93ab287b6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:31.660612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048458f-57d1-4828-b9e3-f93ab287b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:31.660893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048458f-57d1-4828-b9e3-f93ab287b6e2 admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0/groups/5ef7762c7c634ac49c5dc45cf06096bb/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:31.667056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048458f-57d1-4828-b9e3-f93ab287b6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd70255155e6410bb2d9f4554d34cff0, group_id=5ef7762c7c634ac49c5dc45cf06096bb, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:31.670185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048458f-57d1-4828-b9e3-f93ab287b6e2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:31.754406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 214/414] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Jan 10 11:16:31 2022] PUT /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0/groups/5ef7762c7c634ac49c5dc45cf06096bb/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:32.496472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4d3ef-d6e1-46cf-83cb-2a96b3575f12 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.497014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4d3ef-d6e1-46cf-83cb-2a96b3575f12 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.497014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4d3ef-d6e1-46cf-83cb-2a96b3575f12 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.499561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 201/415] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:32.507592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.507993 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.508195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.544223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:32.545445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:32.628827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 215/416] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:32.666411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4d3ef-d6e1-46cf-83cb-2a96b3575f12 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:32.695072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4d3ef-d6e1-46cf-83cb-2a96b3575f12 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:32.699702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:32.700502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.700779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.701048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.716924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:32.724864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:32.729212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 202/417] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:32.731884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:32.747402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3684e-c70d-434e-8c68-9fbf1cd482f0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:32.758872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:32.759552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.759830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.760101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.760873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:32.761177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:32.762823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:32.776445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 216/418] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:32.782654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:32.795520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bc266-a923-4269-aee1-a9af09533fae admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:32.803931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:32.804937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.805468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.806004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.818364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:32.820343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:32.832609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 203/419] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:32.837826 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:32.851742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb0f1-3113-4b1a-b871-e4ed94f3bd51 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:32.863451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:32.864413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.864696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.864971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.871289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:32.873403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:32.875641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 217/420] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:32 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:32.881264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:32.891785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572e6d-dbb5-4342-9107-886aaeefa22c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:32.900265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b2985-cbaf-443b-a14b-43ec745969f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:32.900265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b2985-cbaf-443b-a14b-43ec745969f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.900265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b2985-cbaf-443b-a14b-43ec745969f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.900265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b2985-cbaf-443b-a14b-43ec745969f6 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.901634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b2985-cbaf-443b-a14b-43ec745969f6 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:32.903769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b2985-cbaf-443b-a14b-43ec745969f6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:32.906155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 204/421] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:32 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:32.911905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:32.929662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ad65-5f5f-4017-918f-b551e4422c50 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:32.938660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:32.939326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.939616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.939868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.940723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=c3bf921f7c464742a0bf047e27abb27e) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:32.941034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:32.942931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed19943-8f28-4559-8ec5-94e8f81a77f6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:32.956523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 218/422] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:32 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 611 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:32.977360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773674-e662-4ab1-8775-28da1e4879fe None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.978005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773674-e662-4ab1-8775-28da1e4879fe None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.978555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07773674-e662-4ab1-8775-28da1e4879fe None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:32.980985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 205/423] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:32.988647 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:32.988957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:32.989195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.016033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:33.017173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:33.032804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 219/424] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:33.078107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773674-e662-4ab1-8775-28da1e4879fe None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.094732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07773674-e662-4ab1-8775-28da1e4879fe None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.102630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.103446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.103721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.103989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.121934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:33.129220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:33.130911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 206/425] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:33.136693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.151682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b91c41-e3fc-4c29-a70e-f2f0665a57b8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.162823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.163521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.163797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.164072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.164878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:33.165192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.166918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.178667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 220/426] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.184085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.199770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48711b56-cc3c-4da8-b19a-3a5bd5d31a1a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.210675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.211342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.211622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.211896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.227330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.229109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.239877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 207/427] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:33.245424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.259651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebf870-6d54-4e05-8d74-181eba0b403a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.275136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.275934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.276212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.276481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.277789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.280617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.283076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 221/428] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.289102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.298794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54f992-959f-433c-8f87-089ae0a7a440 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.306282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dce7f-ce16-4645-aeeb-4e3849fe7ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.307137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dce7f-ce16-4645-aeeb-4e3849fe7ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.307409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dce7f-ce16-4645-aeeb-4e3849fe7ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.307675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dce7f-ce16-4645-aeeb-4e3849fe7ae4 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.309622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dce7f-ce16-4645-aeeb-4e3849fe7ae4 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.311799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dce7f-ce16-4645-aeeb-4e3849fe7ae4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.313393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 208/429] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.319767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.331447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942e874-96fa-4abf-a5c4-2b35eda60576 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.338377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.339272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.339772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.340245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.341281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=af16a3c6af664ea2a810122145c3aaa5) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:33.341810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.344599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbbe5-eb83-4c58-bfb8-5f4fc5d7b6f5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.353367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 222/430] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=c32977f9cff44544b097a3692528aa7c => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.455651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a79c5-6a39-418a-ba30-9783053fa54d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.455971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a79c5-6a39-418a-ba30-9783053fa54d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.456202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a79c5-6a39-418a-ba30-9783053fa54d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.458351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 209/431] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:33.463930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.464221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.464485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.484589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:33.486143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:33.498110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 223/432] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:33.525073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a79c5-6a39-418a-ba30-9783053fa54d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.538862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a79c5-6a39-418a-ba30-9783053fa54d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.543853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.545610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.546132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.546637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.561564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:33.569259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 11:16:33.570930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 210/433] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:33.577638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.587864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd82f67-a54f-4b0f-8299-726fb2585818 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.593564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.594653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.595135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.595608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.596642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:33.597162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.599500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.609963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 224/434] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.616131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.627698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c692cf-9a02-4d25-bd4f-f9db52f870d5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.633143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.634127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.634656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.635126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.645106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.647839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.658563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 211/435] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:33.664553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.681073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100975-5c47-4e93-b99b-21003982dbf1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.687451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.688760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.689270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.689748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.691266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.694064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.696504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 225/436] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.702615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.713893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57753de-7518-4488-af19-acc72b232925 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.721368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86602ef-c6fa-440a-b710-3881c88df630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.722661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86602ef-c6fa-440a-b710-3881c88df630 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.723439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86602ef-c6fa-440a-b710-3881c88df630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.723924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86602ef-c6fa-440a-b710-3881c88df630 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.725515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86602ef-c6fa-440a-b710-3881c88df630 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.727898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86602ef-c6fa-440a-b710-3881c88df630 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.730110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 212/437] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:33.737117 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:33.753807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db31ab-1528-4738-9b33-0a18fc806ece admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:33.761009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:33.761700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:33.761955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:33.762254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:33.763114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=c32977f9cff44544b097a3692528aa7c, scope.project.id=c3bf921f7c464742a0bf047e27abb27e) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:33.763425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:33.765990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b54f4-f2ac-4ced-a122-7747eeffc64e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:33.777554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 226/438] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:33 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=c3bf921f7c464742a0bf047e27abb27e&role.id=c32977f9cff44544b097a3692528aa7c => generated 611 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:34.273827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eee65b-7ad8-4e64-bd9f-e92dee28d31a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.274300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eee65b-7ad8-4e64-bd9f-e92dee28d31a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.274409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eee65b-7ad8-4e64-bd9f-e92dee28d31a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.276173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 213/439] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:34.282148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.286138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.286138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.301539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:34.302787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:34.310694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 227/440] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:34.335830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eee65b-7ad8-4e64-bd9f-e92dee28d31a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.349819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eee65b-7ad8-4e64-bd9f-e92dee28d31a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.354017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.354868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.355147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.355417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.366653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:34.374060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:34.375622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 214/441] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:34.381657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.393031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c657ad-1781-4ee2-97fe-ea14377e5f82 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.403857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.405647 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.406082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.406540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.407474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:34.407927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:34.409746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:34.421195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 228/442] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:34.431581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.442726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d8074-7380-42e9-8741-cc3a53109c16 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.452115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.452774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.453057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.453330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.464319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:34.467779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:34.479839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 215/443] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:34.485499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.495704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2847d42-4af9-450e-877f-8e1c626b6950 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.500527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.501397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.501678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.501951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] PATH_INFO: `/v3/projects/af16a3c6af664ea2a810122145c3aaa5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.503283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] RBAC: Authorizing `identity:get_project(project_id=af16a3c6af664ea2a810122145c3aaa5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:34.505743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:34.507084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 229/444] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/projects/af16a3c6af664ea2a810122145c3aaa5 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:34.512603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.522955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce7c5f-0c2d-4a9a-bb30-bb5320e35c7c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.527503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663128f-9411-4c6d-9855-2435eb598b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.528285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663128f-9411-4c6d-9855-2435eb598b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.528588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663128f-9411-4c6d-9855-2435eb598b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.529474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663128f-9411-4c6d-9855-2435eb598b86 admin admin] PATH_INFO: `/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.530841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663128f-9411-4c6d-9855-2435eb598b86 admin admin] RBAC: Authorizing `identity:get_group(group_id=ac0105a5b2db4c68aa47b0ec517830a7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:34.532763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663128f-9411-4c6d-9855-2435eb598b86 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:34.534582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 216/445] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/groups/ac0105a5b2db4c68aa47b0ec517830a7 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:34.541229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.551290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30366b-b1e6-4460-b056-7ddc41db9ca0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.555686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.556328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.556608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.556882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.557721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] RBAC: Adding query filter params (group.id=ac0105a5b2db4c68aa47b0ec517830a7, role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=af16a3c6af664ea2a810122145c3aaa5) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:34.558036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:34.559930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299710bd-4b1e-4d7b-9251-49cf8f8dfce9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:34.566419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 230/446] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/role_assignments?group.id=ac0105a5b2db4c68aa47b0ec517830a7&scope.project.id=af16a3c6af664ea2a810122145c3aaa5&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:34.877986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572ec1-d21c-496d-9ecb-1e21e5f528fe None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.878193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572ec1-d21c-496d-9ecb-1e21e5f528fe None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.878498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572ec1-d21c-496d-9ecb-1e21e5f528fe None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.880246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 217/447] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:34.885437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.885894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.885994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.905053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:34.906241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:34.913801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 231/448] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:34.939399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572ec1-d21c-496d-9ecb-1e21e5f528fe None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.955237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572ec1-d21c-496d-9ecb-1e21e5f528fe None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:34.961683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:34.962494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:34.962777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:34.963048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:34.974361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:34.981280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:34.982733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 218/449] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:34.988636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:34.998054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba54e-7f79-4c74-becb-17ae5bf52e50 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:35.002356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:35.002989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:35.003265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:35.003531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:35.004276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:35.004572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:35.006150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:35.014589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 232/450] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:35.020080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:35.030080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb5a0-d4c3-4cfb-bba6-ad633accfba5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:35.034383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:35.035000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:35.035280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:35.035553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:35.043578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:35.046013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:35.054581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 219/451] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:35.060082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:35.069226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a51a8d-956d-4a90-a1a8-8e8be05133ca admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:35.073390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:35.074206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:35.074509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:35.074776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:35.076477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:35.078307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:35.079936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 233/452] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:16:35 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:35.085092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:35.094795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99290a3-a442-4065-b290-b02d27238d86 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:35.099392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16b6a9-992c-40f3-a282-62cb24e7e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:35.100251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b6a9-992c-40f3-a282-62cb24e7e683 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:35.100528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b6a9-992c-40f3-a282-62cb24e7e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:35.100798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16b6a9-992c-40f3-a282-62cb24e7e683 admin admin] PATH_INFO: `/v3/groups/5ef7762c7c634ac49c5dc45cf06096bb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:35.101989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16b6a9-992c-40f3-a282-62cb24e7e683 admin admin] RBAC: Authorizing `identity:get_group(group_id=5ef7762c7c634ac49c5dc45cf06096bb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:35.104539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16b6a9-992c-40f3-a282-62cb24e7e683 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:35.106629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 220/453] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Jan 10 11:16:35 2022] GET /identity/v3/groups/5ef7762c7c634ac49c5dc45cf06096bb => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:35.113357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:35.124632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a563e1-a07e-426e-a3bd-b8af44e4cec9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:35.129527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:35.130107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:35.130434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:35.130702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:35.132143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] RBAC: Adding query filter params (group.id=5ef7762c7c634ac49c5dc45cf06096bb, role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=fd70255155e6410bb2d9f4554d34cff0) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:35.132706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:35.135023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca264460-6750-45df-b37b-e37e06c40e1a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:35.142884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 234/454] 10.222.0.20 () {56 vars in 1397 bytes} [Mon Jan 10 11:16:35 2022] GET /identity/v3/role_assignments?group.id=5ef7762c7c634ac49c5dc45cf06096bb&scope.project.id=fd70255155e6410bb2d9f4554d34cff0&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:37.924396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15dab2-9e2f-4d3d-982f-f6dc722363f6 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:37.924881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15dab2-9e2f-4d3d-982f-f6dc722363f6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:37.924881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15dab2-9e2f-4d3d-982f-f6dc722363f6 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:37.926899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 221/455] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:37.933214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:37.934309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:37.934731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:37.963215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:37.965238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:37.973558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 235/456] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:38.012400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15dab2-9e2f-4d3d-982f-f6dc722363f6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.030665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15dab2-9e2f-4d3d-982f-f6dc722363f6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.041152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.042690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.042967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.043245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.056954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.058942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.092834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:38.094479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 222/457] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:38.100405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.120777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940f8e4-b059-4ef4-86b2-a359725e3ca9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.128126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.129079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.129572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.130043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.131110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:38.131641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.132864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:38.132864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:38.132864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:38.134070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242047d-f15b-46da-8cba-929394aea01d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.155909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 236/458] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:38.161155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.176027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e95d5-4e6f-4ba2-be53-81102f4e4a04 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.184011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.184680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.184965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.185235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.185966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.187936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.203134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1b5a-2518-49b4-ae2a-fafb1d8ce540 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.203702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1b5a-2518-49b4-ae2a-fafb1d8ce540 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.204173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd1b5a-2518-49b4-ae2a-fafb1d8ce540 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.206408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 237/459] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:38.211087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.211579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.212047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.230991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:38.232476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:38.240748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 238/460] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:38.267925 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.277943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614591d-2493-402f-aab0-1e54cde4212d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.283109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.284261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.284769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.285221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.297743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.300005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.320053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:38.321267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 239/461] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:38.324252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 223/462] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:38 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:38.328082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.339006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ec918-e968-44a9-b115-d5504226439d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.350422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.351103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.351383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.351656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.352415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:38.352720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.356252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9682126-7eb2-4c58-aee2-f38c04cacd36 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.376289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 240/463] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:38.382161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.397930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5190ba9-a60c-4bed-89a7-1145f410805e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.405910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9535b8-bb58-4985-af7a-736d913146f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.406665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9535b8-bb58-4985-af7a-736d913146f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.406999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9535b8-bb58-4985-af7a-736d913146f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.407279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9535b8-bb58-4985-af7a-736d913146f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.408020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9535b8-bb58-4985-af7a-736d913146f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.409959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9535b8-bb58-4985-af7a-736d913146f4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.521072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 224/464] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:38 2022] POST /identity/v3/users => generated 248 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:38.801422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9842-13a7-4a24-b24b-c72edf837393 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.801603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9842-13a7-4a24-b24b-c72edf837393 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.801873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9842-13a7-4a24-b24b-c72edf837393 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.803964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 241/465] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:38.810266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.810569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.810830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.833090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:38.834348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:38.845683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 225/466] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:38.872950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b9842-13a7-4a24-b24b-c72edf837393 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.891096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b9842-13a7-4a24-b24b-c72edf837393 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.896140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.896930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.897204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.897475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.909747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.911617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.929058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:38.934328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 242/467] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:38.936697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:38.950842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903b46-1c1f-4be9-97e7-1bd7b7cbea2b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:38.957038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:38.958040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:38.958583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:38.959062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:38.960061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:38.960584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:38.962597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba51f4a-946f-4a4e-bfec-4260f14b20e9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:38.982118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 226/468] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:38.990753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.003512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf3a3b-d978-4fd8-a130-092c6e7bda83 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.007920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.008582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.008861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.009135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.009871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:39.013677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:39.066658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4686f4-509f-4a6e-9295-4710e1ec55d0 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.066940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4686f4-509f-4a6e-9295-4710e1ec55d0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.067127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4686f4-509f-4a6e-9295-4710e1ec55d0 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.068885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 227/469] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:39.074090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.074404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.074679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.093419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:39.094663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:39.102998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 228/470] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:39.130473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.204341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb511-f048-464f-bd08-55fb8bc67cd8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.213101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.213899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.214177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.214323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 243/471] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:38 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:39.214586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.232674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:39.241635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:39.265522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:39.267335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 229/472] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:39.273081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.286078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ddee2-6cab-4454-8c48-bf9e4dfe21ee admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.295508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.296236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.296520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.296799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.297691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:39.298008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:39.303495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098cd35-bb19-4591-84ce-7c7d23948a8c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:39.326907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 244/473] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:39.329362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.355320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561474a-383b-4098-8248-be86235a6a3e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.368432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.369641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.370138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.370672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.371998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:39.375693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:39.414467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6ed5-71b8-435b-a6cc-3d20e622c1da None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.414938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6ed5-71b8-435b-a6cc-3d20e622c1da None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.415363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb6ed5-71b8-435b-a6cc-3d20e622c1da None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.419353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 245/474] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:39.428031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.428456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.428902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.457625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:39.459494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:39.474248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 246/475] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:39.510575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 230/476] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:39 2022] POST /identity/v3/users => generated 249 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:16:39.518013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.534096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da377ac-0579-4daa-bce5-9e19d2e45b94 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.541333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.542431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.542851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.543263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.544579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:39.547699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:39.592919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.sql.core [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 10 11:16:39.592919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 10 11:16:39.592919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [parameters: {'id': '7286ef3b6fbb439ea670fb75c6cca57a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 10 11:16:39.592919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 11:16:39.618906 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 10 11:16:39.623851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 247/477] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:16:39 2022] POST /identity/v3/roles => generated 144 bytes in 105 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:39.629753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.647573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf464e-f06d-4e22-b7cb-c5e6457a779a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.656442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a49315-024e-4f81-819a-56c8aa413a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.657703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49315-024e-4f81-819a-56c8aa413a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.658155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49315-024e-4f81-819a-56c8aa413a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.658625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a49315-024e-4f81-819a-56c8aa413a73 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.676663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a49315-024e-4f81-819a-56c8aa413a73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:39.689867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b3a49315-024e-4f81-819a-56c8aa413a73 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 11:16:39.692204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 231/478] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:16:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:39.701377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:39.718424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb033c-61ab-44f2-8179-db291ec680ac admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:39.725281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:39.726383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:39.726845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:39.727272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:39.728615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:39.729110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:39.731921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fe928-0f81-45f1-8774-bc9b18316a39 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:39.748254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 248/479] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:41.425454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0307feb-05bd-477f-8698-e9844d6d4500 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.426153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0307feb-05bd-477f-8698-e9844d6d4500 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.426153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0307feb-05bd-477f-8698-e9844d6d4500 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.428091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 232/480] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:41.433987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.434586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.434586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.453243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:41.458533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:41.470609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 249/481] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:41.515861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0307feb-05bd-477f-8698-e9844d6d4500 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.532749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0307feb-05bd-477f-8698-e9844d6d4500 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.541847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.542664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.542938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.543205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.559218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:41.566124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:41.567507 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 233/482] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:41.573219 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.582244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e744a0a-5790-4323-a248-9edc0adf4a7f None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.590593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.591256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.591532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.591804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.592568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:41.592869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.594504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.604167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 250/483] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:41.609352 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.623382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ca63b-3931-4d52-9a9c-62b863f8860b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.630811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.631593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.631865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.632131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.647346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.649391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.669049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:41.674326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 234/484] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:41.675828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.691881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837196d2-eeec-4b14-8cc0-ff015b898c80 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.707800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.708475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.708754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.709031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.709772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:41.710074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.712334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.734008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 251/485] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:41.739324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.755227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5734c0e-2fa1-4e5e-b440-77ae87407a6e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.762151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.762960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.763242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.763517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.783525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.787923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.809896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:16:41.814342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 235/486] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:41.816795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.829127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb405a9-1bc6-4e6b-b556-8451528abdac admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.834223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.834890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.835172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.835447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.837280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:41.837592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.838871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:41.838871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:41.838871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:41.840006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.884737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 252/487] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:41.890178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.908346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdfe80-c852-42c0-86f0-00b745d8e873 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.915964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74048412-5b77-47be-a1f3-2398c2a079f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.916665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74048412-5b77-47be-a1f3-2398c2a079f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.916945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74048412-5b77-47be-a1f3-2398c2a079f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.917218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74048412-5b77-47be-a1f3-2398c2a079f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.930786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74048412-5b77-47be-a1f3-2398c2a079f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.932460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74048412-5b77-47be-a1f3-2398c2a079f8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.942696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 236/488] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:41.948484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:41.959835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7c9e8-ae10-436e-a285-79c5149d89a4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:41.975522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:41.976331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.977322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.977691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.988611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c715a2-c9da-4baa-8018-0330ba15de0b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.988949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:41.989107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c715a2-c9da-4baa-8018-0330ba15de0b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.989268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c715a2-c9da-4baa-8018-0330ba15de0b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:41.990787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:41.991320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 237/489] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:41.996229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:41.996465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:41.996740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.010044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:42.011590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 253/490] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.019352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.021628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:42.025948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:42.037649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bcf7b-00b8-4ad6-8224-bf6e26685a3a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.041032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 238/491] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:42.049727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.050467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.050752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.051029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.051869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.052228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.053956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.074766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 254/492] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:42.080464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.095886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80722ef6-5cc5-45b1-88a8-ee526da3d9fa None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.106915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.107827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.108111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.108385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.119641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.121669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.129931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.146460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25de2f-d04f-4b43-beae-1f7ae796b87d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.153021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:42.156290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.157100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.157426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.157700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.163893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 239/493] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.168692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.187796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d51af-4235-452a-bc73-a004e1133973 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.197155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.198615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:42.199295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.199775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.200181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.201778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.202344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.204271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:42.204271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:42.204271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:42.205513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:42.205871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.211477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 255/494] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.220132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.234144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fddd2-7373-4941-a2f9-cb15a7f7450d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.246934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 240/495] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:42.248738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.249628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.250100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.250524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.251479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.251969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.253837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.266133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 256/496] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:42.271350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.279715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.282302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33911a-ba08-4123-97c8-814c99f9e2d4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.291289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.292160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.294075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.294511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.296487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=df05886e51f34628a524477b98227f40) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.298109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.302329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.304191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0b8f4-adab-4911-9a3c-3d38f09e7e97 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.314112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.315394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 241/497] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/role_assignments?user.id=df05886e51f34628a524477b98227f40&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.322700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.323020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.323300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.335099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.337784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.364646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:42.367597 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 257/498] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.372608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.384013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f028-2d56-405f-8fd9-e639e8bce1ce admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.391201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.391886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.392163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.392433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.393186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.393561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.395290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.409806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 242/499] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.415862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.428099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdae2c-9503-423a-a92f-54d14ab6b8f6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.437682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.438655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.438981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.439316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.448134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.450394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.471413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 11:16:42.473174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 258/500] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.479397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.496045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c983-8ba9-46f4-b101-2105ca88b4fc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.503668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.504565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.504913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.505255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.506243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.506644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.507807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:42.507807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:42.507807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:42.509226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc832c-89ea-4378-acac-bfdb9994ada9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.572996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 243/501] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.578685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.592584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bf9bd-adc9-44e4-8a71-e87ec9a1a779 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.606239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.606956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.607239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.607511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.614470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39b85d-48b4-4e0e-ba58-4389f992561b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.614777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39b85d-48b4-4e0e-ba58-4389f992561b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.615017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39b85d-48b4-4e0e-ba58-4389f992561b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.617172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 244/502] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:42.621754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.623118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.623403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.623670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.623856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.635639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 259/503] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:42.641699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.651860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a3cf0-6e3b-4ff8-a4a7-f21d5465f2f4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.659191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.660036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.660314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.660680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.667419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:42.668667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:42.674095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.676850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.685888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 245/504] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:42.697355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:42.699571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 260/505] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.704766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.715269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e12a7-8d91-4247-a081-86052f63f093 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.718054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.725942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.727087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.727650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.728139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.728805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a1440-704a-44cc-bce9-a8ef0ea621f0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.729424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.729930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.732247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.733281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.734060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.734382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.734660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.747744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:42.753035 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 246/506] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.759905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:42.764864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 261/507] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:42.766276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.771808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.781074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb421-5a62-46ec-ba09-4bc86e9adb49 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.785514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4123b1-6da4-46bf-bb24-6c52906891d0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.790533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.791474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.791808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.792153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.793092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.793495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.794119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.795200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.795305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.795744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.796272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.810433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 262/508] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.810979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.811893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.813524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.824176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cf0ce-7b7b-4507-b29d-783356526ec8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.829104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.830181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.830644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.831129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.842632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.844854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.846386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:42.852994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 247/509] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.868166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.870755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:42.876840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 263/510] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.878318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.885859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b41af-6695-4def-9fca-6750f8a1433c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.888890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850157f-219e-4ed7-8ede-59248a7a14fe admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.894472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.895307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.895747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.896266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.897185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.898194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.899275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.900051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.900438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.900595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.900913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.901827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.902260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.904344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a5036-4cce-4ecd-b378-4d57372840c2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.919516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 264/511] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.921015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.931770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de211b-4646-4f58-9a86-b4aa5a3cbf19 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.935950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 248/512] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.938266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb542b3-e517-4361-a21e-deb8fbe6856d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.938266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb542b3-e517-4361-a21e-deb8fbe6856d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.938714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb542b3-e517-4361-a21e-deb8fbe6856d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.941231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 249/513] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:42.942044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb542b3-e517-4361-a21e-deb8fbe6856d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:42.942918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.943970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.944385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.944941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.956611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.958943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.961686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb542b3-e517-4361-a21e-deb8fbe6856d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:42.966943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:42.967744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.968168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.968502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.969542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=86a45f34ca2b48e1ad61d3064715625f) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:42.969951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:42.972215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339a2d4-11a6-4ff5-aaae-9dc3205deeca admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:42.976793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-7a229c3d-5317-44d0-81df-a69c24b924cb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 11:16:42.986243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 250/515] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/role_assignments?user.id=86a45f34ca2b48e1ad61d3064715625f&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:42.986243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afab7c-5eef-4b1a-af8f-4ef8c206d762 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.986243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afab7c-5eef-4b1a-af8f-4ef8c206d762 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.986243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afab7c-5eef-4b1a-af8f-4ef8c206d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.986705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 265/515] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:42.992945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944ea9-ce2c-412c-9fa2-3dae77761669 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:42.993387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944ea9-ce2c-412c-9fa2-3dae77761669 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:42.994024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944ea9-ce2c-412c-9fa2-3dae77761669 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:42.997346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 266/516] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:42.998339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944ea9-ce2c-412c-9fa2-3dae77761669 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.013059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-31afab7c-5eef-4b1a-af8f-4ef8c206d762 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:43.015196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-31afab7c-5eef-4b1a-af8f-4ef8c206d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:43.019827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944ea9-ce2c-412c-9fa2-3dae77761669 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.025401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.026045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 251/517] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:43.032396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.032396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.032396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.033557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.034155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.034697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.036603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.038194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.040434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.049059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:43.050344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:43.070411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 267/518] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Jan 10 11:16:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.071646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.072835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 252/519] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:43.076495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.082517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df675c84-36fa-415c-b30e-d7473cb000b1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.095288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.096806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.097476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73782d56-4424-4626-aea3-55b4df8d2906 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.098277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.098710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.112308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.113383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.113678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.113955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.115874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.118290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.123637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.125455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.141008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 253/520] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:43.141877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.146543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:43.149309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 268/521] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:43.150476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.157814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60c7ee-2833-4133-9524-a6b682efbd69 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.164368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.165177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.165454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.165723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.166401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac1072-ca2a-4096-9e92-cfe2b6d8f0f3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.172569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.173886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.174577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.175385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.178904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:43.187719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.188177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:43.189584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 254/522] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:43.190182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.190654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.207696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c870d58-737d-4413-b579-4bbc9e90b6bb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.213284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.214181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.214663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.215085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.215970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.216418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.218372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.218794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:43.220132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 269/523] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:43.220912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.232097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85226f03-5901-4583-b0f0-28c320a7a226 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.232341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 255/524] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.233456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.240957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.242420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.243124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.243549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.245110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.245425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.247483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.249337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af6ab2-365b-4137-9459-8cad57492e88 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.256637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 270/525] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.258871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.262802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.263481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.264022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.264293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.265030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.265332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.267058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.276764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def3d1-0776-4e24-a8d2-01f0e022edf4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.281444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.282152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.282560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.282792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 256/526] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.282910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.283593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.284226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.285846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.295346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c46d0-d201-4108-9d93-503691103fe8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.300185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.300974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.301255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.301528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.312949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.314844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.335207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:43.337643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 257/527] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:43.342418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.352774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6b54e-b341-47b4-ab99-cd3da549f630 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.357154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.357943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.358238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.358518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.365680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.368312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.383482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:43.384388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 258/529] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:43.385411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.386294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 271/529] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:43 2022] POST /identity/v3/users => generated 247 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:43.391340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.404674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b6361-fd98-4e24-ae0f-1c96f727e71d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.406103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd116f70-d04f-4773-9126-468ae2053e55 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.409728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.410613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.410975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.411379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.412276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.412654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.414784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:43.414784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:43.414784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:43.416384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.417769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.418560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.418918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.419297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.420651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.421273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.423067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.441223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 272/530] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.446263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 259/531] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.451332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.451658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.473311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965852e-5b1e-488f-8f73-0bc350173d95 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.476535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87f96-2e11-4ff0-a178-96a943deab64 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.485161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.487424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.488238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.488735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.489148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.490307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.491294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.492058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.494708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=a04d0effd2d54f28af90ede3c495a368) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.496083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.498191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.509791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.513847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.525236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 273/532] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/role_assignments?user.id=a04d0effd2d54f28af90ede3c495a368&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.534337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 11:16:43.536340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 260/533] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:43.547688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.559119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edb9d0-b8da-4ac3-89a8-e2e271aa4d13 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.566558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.567566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.568035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.568455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.570141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.570719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.572850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.605823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 274/534] 10.222.0.20 () {56 vars in 1160 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.611309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.624526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41803b36-345b-4b0f-a6eb-cbf6fc3baa95 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.629279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.629993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.630298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.630568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.653470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.655436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.668800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 261/535] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:43.674242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.686500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d3d9-39c3-4ea8-9649-b18fe46aabaa admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.691388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84371-a587-428f-858a-644255142abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.692244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84371-a587-428f-858a-644255142abf admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.692518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84371-a587-428f-858a-644255142abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.692792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84371-a587-428f-858a-644255142abf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.707933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d84371-a587-428f-858a-644255142abf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.710438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d84371-a587-428f-858a-644255142abf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.731324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-81d84371-a587-428f-858a-644255142abf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:43.733213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 275/536] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:43.740404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.751906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19386371-ccea-4c82-907e-bf069ae922e7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.759073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.759906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.760314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.760693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.761550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.761964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.764012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.779690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 262/537] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:43.785884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84371-a587-428f-858a-644255142abf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.797695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84371-a587-428f-858a-644255142abf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.802937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.803863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.803863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.804622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.821569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.824274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.845205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:43.847450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 276/538] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:43.856113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.868564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28168-53f6-48c5-a382-92283cfc2097 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.876163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.876981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.877341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.877687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.878666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.879123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.881184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c59a5-0098-44e2-9962-6c5802ebe6cc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.896785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 263/539] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:43.905429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:43.922692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33809e-cb64-449a-8972-95aa3fa3970d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:43.930139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:43.932113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:43.932113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:43.932113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:43.932565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=dd7492ffb2a543979f94421c2649e5de) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:43.932892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:43.934898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46046e-02b7-4af5-bb55-3628b6282e9f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:43.943429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 277/540] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:43 2022] GET /identity/v3/role_assignments?user.id=dd7492ffb2a543979f94421c2649e5de&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:45.686508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51b77-bf98-4b09-b12a-dcebbbdcd580 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.687027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51b77-bf98-4b09-b12a-dcebbbdcd580 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.687334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae51b77-bf98-4b09-b12a-dcebbbdcd580 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.690255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 264/541] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:45.696621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.697099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.697173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.726447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:45.727642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:45.737402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 278/542] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:45.773219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51b77-bf98-4b09-b12a-dcebbbdcd580 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:45.791823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae51b77-bf98-4b09-b12a-dcebbbdcd580 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:45.796373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:45.797162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.797440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.797711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.815145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:45.822778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:45.824361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 265/543] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:45.829966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:45.843189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8988-b1fe-4b7a-8611-60825cad970b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:45.847877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:45.848542 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.848856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.849140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.849990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:45.850320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:45.851925 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:45.869405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 279/544] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:45.874995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:45.887586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db02bc-c621-4c56-87bd-f9bcdbf9b813 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:45.902926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:45.903737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.904017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.904289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.922387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:45.924296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:45.950418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-625b6ea4-6eda-46e1-bd62-fa375708b576 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:45.952004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 266/545] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:45.957076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:45.967895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1dcd-d790-40bc-9930-ff7a783de74b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.968221 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1dcd-d790-40bc-9930-ff7a783de74b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.968454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1dcd-d790-40bc-9930-ff7a783de74b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.970591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 267/546] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:45.971380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946c7d9-9a34-4fd6-8aba-f1a99dd02c30 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:45.975875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:45.976537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.976819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.977091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:45.977836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:45.978138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:45.983644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:45.983902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:45.984078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:45.984231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.009024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 280/547] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.014033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.019491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:46.021362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:46.028623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaff83-7d0a-4d92-954e-a36a640d6610 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.037973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.038810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.039092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.039368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.040578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 268/548] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:46.048327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.050424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.065176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:16:46.066781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 281/549] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:46.072530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.075529 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.085379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d9f24-c453-4561-b2a3-b2f0046a6b72 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.091513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ac0d0-64a5-4f77-848d-61ade27d0c19 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.099821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.100683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.101716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.102620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.103129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.103735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.104146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.104612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.106251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.108468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.110616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.121661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:46.128547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:46.130844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 282/550] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.137472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.148148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60c415-b509-4f81-9149-5af4353c932e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.153883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 269/551] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.155857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.156526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.156806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.157079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.157844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.158378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.159797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.163141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.178281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597599-2a82-447e-a7be-1a2fab455911 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.180543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 283/552] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:46.182804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.183595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.183871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.184141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.187323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.200627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.202864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.203304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e4c2e-2e36-46ed-8c9d-4773c3f0dea1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.208266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.209218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.209502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.209770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.225043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.228390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.236802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:46.241296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 270/553] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.255404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.273305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:46.277298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db728e-7e21-4b21-a956-1c972b43bd5c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.279590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 284/554] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.286898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.295377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.296433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.296924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.297396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.298381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.298885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.300734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.309226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826c1d6-ce7b-4a67-ac34-07ab4fea1209 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.320493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 271/555] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.327071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.327997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.328999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.329478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.329944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.330930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.331452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.333987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.352208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 285/556] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.354150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.356747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea3c96-6866-4638-a583-4b006f65505c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.368411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1b4ee-4ff2-40fe-837d-00364a67d38c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.368610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.369483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.369771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.370050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.378310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.379174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.379447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.380338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.387876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.389888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.390023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.392220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.408039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 11:16:46.409540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 286/557] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.415097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.418857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:46.420082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 272/558] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.426603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.435257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cc60d-3c62-4c5e-8120-e7e6fff773a0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.437002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9de4e4-c06a-4a04-b195-7accd712ae16 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.444034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.445240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.445528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.445804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.446591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.447245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.447969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.448247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.449037 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.449348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.451137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.451448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.453269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.455252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.466370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 273/559] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.475176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.485699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 287/560] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:46.492032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.493738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85eb1f-4b05-4485-afdc-4ec41b4133fd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.507945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806459-c4af-4c05-a49d-127ab8ff1d34 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.512524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.513472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.513753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.514025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/df05886e51f34628a524477b98227f40/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.518489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.519774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.520057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.521608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.543837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.545638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.551242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=df05886e51f34628a524477b98227f40, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.555344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.574568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:46.576317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 288/561] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:46.581609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.592233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b659d-8d6c-4c97-9864-f4e79686e7c7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.597810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.599924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.600444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.601005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.604160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.604842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.608068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.628868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 289/562] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.635397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.647372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83ff33-58cf-417b-b0db-256efe9f8db1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.653172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.654464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.654964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.655495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.664705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.667059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.672613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 274/563] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:46 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/df05886e51f34628a524477b98227f40/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:46.682863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-aa03390a-4ac0-4c3d-be64-90bfbba0dedd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:46.688982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 290/564] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.691098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.811122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1bc0-2140-41ee-9edd-7f7a99b1a964 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.818696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.819444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.819731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.820002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.820827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:46.821136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.823175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b15a-5902-48c8-80cd-d0e62cc02a79 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.840838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 275/565] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:46.843714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec3fbf-92ea-45b2-b7b7-cb962680c00c None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.844570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec3fbf-92ea-45b2-b7b7-cb962680c00c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.845047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec3fbf-92ea-45b2-b7b7-cb962680c00c None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.847183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 291/566] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:46.853099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d44a8-6f6c-4afa-a3af-4d634d302cb8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.853389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d44a8-6f6c-4afa-a3af-4d634d302cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.853664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d44a8-6f6c-4afa-a3af-4d634d302cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.858349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec3fbf-92ea-45b2-b7b7-cb962680c00c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.869165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec3fbf-92ea-45b2-b7b7-cb962680c00c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.876508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.877406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.877683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.877950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/86a45f34ca2b48e1ad61d3064715625f/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.879464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0a7d44a8-6f6c-4afa-a3af-4d634d302cb8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:46.881816 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0a7d44a8-6f6c-4afa-a3af-4d634d302cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:46.892287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 276/567] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:46.893572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e51d7-1843-4276-b893-25029776fcdc None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.893858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e51d7-1843-4276-b893-25029776fcdc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.894128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e51d7-1843-4276-b893-25029776fcdc None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.896281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 277/568] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:46.902692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.903073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.903354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.904226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=86a45f34ca2b48e1ad61d3064715625f, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:46.907179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:46.929951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:46.931199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:46.940359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 278/569] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:46.941196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.951382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7486b-62ce-4993-b3c6-913b8fc35683 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:46.956171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:46.957017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:46.957301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:46.958105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:46.970374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:46.978273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:46.979939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 279/570] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:46.981195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:46.990247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 292/571] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:46 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/86a45f34ca2b48e1ad61d3064715625f/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:46.991008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.000400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96bb4b-a0bf-446c-a7be-bbec30f29ba4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.078553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaabe48-93b0-46d0-91e1-d69274af3fc2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.089439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.092278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.093594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.094066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.095087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.095841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.101436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.118572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.119743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.120786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 293/572] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.121304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.121844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.126412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.149573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44feb32f-5407-4762-a9b6-28eaaf475a06 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.150631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:47.158955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:47.162587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 280/573] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:47.167143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.167893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.168181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.168459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.169779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.183871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fffc39-e1fa-40d3-8605-c59e7109eff5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.190177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.195460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.196437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.197397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.198368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.199122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.200865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.202349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.205587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.229358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 281/574] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.234810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:47.236840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 294/575] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.242333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.245924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.256475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3281cac-fa41-45b4-a047-a2b85c6fec6a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.256660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f158f7-c514-4fcd-852c-635394cd29d0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.262497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.262968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.263294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.263575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.263846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.264746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.265245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.266011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.267464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.267982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.270554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.277281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.279083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.290160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 282/576] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.294959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.298375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:47.304181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 295/577] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:47.305644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.307989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d4884-dd3f-4c19-9809-28b3299d1c63 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.313418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.314321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.314658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.314999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.315173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1786b-2c4d-4c8b-b0d6-41f6badcaca9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.322144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.322835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.323120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.323388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.324130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.324431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.326041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b73b1-b826-433a-8643-e42b9a8a33a6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.332023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.333600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.344009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 296/578] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:47.345658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a1589-7ff4-4e8e-b441-1e1cfa810fe1 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.346142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a1589-7ff4-4e8e-b441-1e1cfa810fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.346602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a1589-7ff4-4e8e-b441-1e1cfa810fe1 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.349124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 297/579] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:47.353238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 11:16:47.354276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 283/580] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.354988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.355106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.355587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.356116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.365686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f0f9-85a0-4c0f-900e-a2d31d8b002d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.370280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.371126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.371458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.372040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.378115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:47.380345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:47.380596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.382826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.390292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 298/581] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:47.398263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.398417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 11:16:47.403891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 284/582] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.405105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.408532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafe5bd-ed5c-4e1c-a0c4-b20367f20b5a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.420247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919943b-07f9-4aa9-860b-f46b12a9ad4b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.421060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.421735 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.422601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.422879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.424615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.424927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.429463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.434434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.435105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.435382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.435651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.436509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.436811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.438705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.460157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 299/584] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.461290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.462341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 285/584] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:47.465167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.473111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ecb73-c28c-4d84-8e05-3c9e6afb3800 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.475111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e69532-6886-43a1-95ba-8a556f993b5d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.478483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.479592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.479847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.480196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.480613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.480732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.480999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.481276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.493756 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.495175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:47.495658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.503848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:47.511856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 300/585] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.513483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.514634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:47.520348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 286/586] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:47.521260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.524321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711a100-7cae-418e-8321-fcb60900a66e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.529951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.530802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.531229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.531518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d3b38-cfb6-4aed-b218-78f20a27e951 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.531837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.536208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.536913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.537249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.537524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.538341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.538669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.540357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.543552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.545505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.549118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 287/587] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.550168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.558146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 301/588] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:47.563531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.565175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386793-5ad7-4f1f-9648-cdcdbe495f8a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.570728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.571890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.571890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.572065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.572893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.573200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.574916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.576328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944247a-f0bd-468b-a71b-3c1bcafbd5e6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.580952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.581977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.582575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.583060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.592891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 288/589] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.593792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.594574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.596695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.604313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333096c4-7f24-4471-a9ec-91f79a580c06 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.609390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.610251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.610588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.610874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.616690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:47.618345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 302/590] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.619260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.622988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.625001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.629805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80ddc-f0e2-4722-8f00-436ec2d9d394 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.634380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.635278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.635660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.636312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.643661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.644076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:47.646247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 289/591] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.647044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.651295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.661430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9f384-568f-4c9c-8e2c-abc24858740c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.665979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.666767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.666885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:47.667245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.667609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.668185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 303/592] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.668532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.668935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.670708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.674069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.684943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 290/593] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.686014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.687095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66b85d-7be2-4144-b6a5-d94c872cdcb8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.695053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.695848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.696138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.696413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.697159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.697380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7876c-e2a7-40ee-8f49-51b17437cace admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.697796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.699412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.702912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.703626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.703911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.704276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.705078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.705387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.708686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.713283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 304/594] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.714196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.729508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed065f5-3808-42f3-bf06-82fe09b94db9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.732178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 291/595] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.733129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.743870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.745067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.745350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.745627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.747044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e861-94be-446e-8fb9-035db9b5a0ed admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.752049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.753291 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.753644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.753892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.754121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.756370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.763007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.765552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.774015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:47.775620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 305/596] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.776479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.781366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 11:16:47.783484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 292/597] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:47.786593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.792725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b885e8-150b-4e13-80bb-67cd35ada86d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.797397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.797596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a818b-0f9c-4b99-959e-e961613bd78e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.798371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.798650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.799091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/a04d0effd2d54f28af90ede3c495a368/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.802989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.803774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.804154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.804528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.805444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.805875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.807906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.815879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=a04d0effd2d54f28af90ede3c495a368, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.819587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.821835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 293/598] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.822888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.833657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ab6d0-18b0-4754-94e2-6f70fbbe0479 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.838119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.838923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.839298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.839671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.840634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.841040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.843072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.881420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 294/599] 10.222.0.20 () {56 vars in 1160 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.886246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.896735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a95a3-6a73-419a-b58a-8327cde32994 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:47.901268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:47.901968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:47.902351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:47.902723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:47.903627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=bccfc902f07f4298afeba04f08176891) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:47.904008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:47.905908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:47.912410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 295/600] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/role_assignments?user.id=bccfc902f07f4298afeba04f08176891&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:47.913419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:47.916389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 306/601] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:47 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/a04d0effd2d54f28af90ede3c495a368/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:47.929048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1db108-a0f2-44d4-be7b-5b0548510193 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:48.018935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:48.020853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:48.025279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:48.025608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:48.054391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:48.057643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:48.086670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:48.088207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 296/602] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:48.093577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:48.115416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b794-3b60-4fc5-ab51-bff2e5bb1cef admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:48.126457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:48.127541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:48.128076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:48.128550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:48.130180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:48.130809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:48.132863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:48.159725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 307/603] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:48.165185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:48.180664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64405b-be38-482f-8bb6-15a9a67df117 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:48.197342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:48.197342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:48.197342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:48.197342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:48.214235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:48.216684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:48.232863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:48.234862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 297/604] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:48.241158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:48.251954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a75ca-082e-4ee3-87ca-b5d76dec6b2e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:48.258748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:48.259722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:48.260151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:48.260909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:48.261929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:48.262525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:48.264712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaa07a-2837-488a-987a-79dd64cbc2ac admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:48.279805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 308/605] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:48.287093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:48.299785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fc342-bb8c-459c-8c4f-9c4b37729eae admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:48.305842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cc47e-06d0-44fd-871d-b1853e3377c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:48.307111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cc47e-06d0-44fd-871d-b1853e3377c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:48.307593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cc47e-06d0-44fd-871d-b1853e3377c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:48.308063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cc47e-06d0-44fd-871d-b1853e3377c0 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/dd7492ffb2a543979f94421c2649e5de/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:48.329537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cc47e-06d0-44fd-871d-b1853e3377c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=dd7492ffb2a543979f94421c2649e5de, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:48.333406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cc47e-06d0-44fd-871d-b1853e3377c0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:48.434556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 298/606] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:48 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/dd7492ffb2a543979f94421c2649e5de/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:49.452464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc39ba-110d-4687-93b4-62c4298f9098 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.452998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc39ba-110d-4687-93b4-62c4298f9098 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.452998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc39ba-110d-4687-93b4-62c4298f9098 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.455064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 309/607] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:49.461414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.461865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.461967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.484034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:49.485233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:49.560172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 299/608] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:49.600203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc39ba-110d-4687-93b4-62c4298f9098 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.614790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc39ba-110d-4687-93b4-62c4298f9098 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:49.619554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:49.620374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.620656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.620931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.643240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:49.650568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:49.651801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 310/609] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:49.657513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.666992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652b8a0-5011-4251-bd84-2032284043ba None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:49.674361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:49.675976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.676262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.676533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.677311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:49.677613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:49.679256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:49.688362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 300/610] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:49.694445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.709100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd198e87-12d2-4ad8-96ed-1f828543de48 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:49.718485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:49.719287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.719564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.719835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.744050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:49.745914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:49.775761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:49.782752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 311/611] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:49.786584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.804325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c1123-8535-46f9-b999-6116b9bb4a6e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:49.815959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:49.816635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.816915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.817189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.817937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:49.818325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:49.819956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:49.841578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 301/612] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:49.842822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.858048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad3cd0-0da9-41f0-bd8c-81a67c9c77ed admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:49.867589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:49.868377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.868651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.868920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.883540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:49.885816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:49.910793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:16:49.912010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 312/613] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:49.917530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.932057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf598-3302-4c7b-aa41-5e47558b7088 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:49.947791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:49.948471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:49.948748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:49.949018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:49.949887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:49.950192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:49.952085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:49.978708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 302/614] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:49.984065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:49.999334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b793c-1997-4147-a398-6de1f09d328c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.011793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.012455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.012737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.013010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.029892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.031668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.047938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 313/615] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:50.054284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.067890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9663d-1d08-41e3-9132-0886a6bdebe0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.082936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.083754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.084026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.084296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.095504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.098025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.134778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:50.137275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 303/616] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:50.143332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.157771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24810e6-8fc6-4025-b025-4ac8bfb78b67 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.179247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.180289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.180570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.180838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.181584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.181884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.184111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b378c7-23f1-479d-8649-a9143df40099 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.211450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 314/617] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:50.218599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.229323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98120320-718a-4e4a-ae80-4d3e5f9f350e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.242072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.242898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.243179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.243454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.253679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.255677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.276624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc2c40-7d9b-4f8d-8c76-ecb5fd7f38ab None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.276927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc2c40-7d9b-4f8d-8c76-ecb5fd7f38ab None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.277171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc2c40-7d9b-4f8d-8c76-ecb5fd7f38ab None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.279227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 315/618] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:50.279843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:50.281130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 304/619] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:50.284849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.285125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.285403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.287101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.301440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d07f40-a6a4-48d9-81b4-7b03d11a3fc4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.315196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.315854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.316133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.316401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.317195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.317494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.319363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.321952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:50.323283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:50.338839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 305/620] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:50.340964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 316/621] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:50.348476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.359963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26596093-52f8-4579-985e-5f216c9af15b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.366854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.367524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.367790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.368065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.368910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=df05886e51f34628a524477b98227f40) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.369220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.371114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.378432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 306/622] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/role_assignments?user.id=df05886e51f34628a524477b98227f40&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:50.403939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.419790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2044e-86c3-4484-b8de-cb92ad3e00be None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.426599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.427662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.428152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.428603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.450608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:50.458779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:50.460745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 317/623] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:50.466815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.481669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118736c-91cf-4476-8bd4-f58bf52411de admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.500250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.500956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.501238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.501522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.502382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.502858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.504558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.522279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 307/624] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:50.527699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.544122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce92a-cec1-4dc1-9a8c-30e989d59779 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.554737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.555979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.556618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.557342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.569815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.572042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.590181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:50.592207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 318/625] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:50.598340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.617412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8687a3-2c11-47a6-b5d8-f6dd425e8230 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.629701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.630408 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.630690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.630969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.631727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.632031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.633709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.652694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 308/626] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:50.658369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.680136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895636-5ab4-401a-b81a-7bcdaa07dfa4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.691085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.691909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.692189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.692460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.709259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.712060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.726838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 11:16:50.728671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 319/627] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:50.733971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.751613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499e53-902d-4888-9a82-f0435fcde67f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.759708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.760388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.760666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.760941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.761813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.762127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.764217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.786010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 309/628] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:50.791297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.801847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2b7eb-3863-41c6-befd-a843680672e2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.806599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.807292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.807751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.807946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.817658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.823370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.834810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 320/629] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:16:50.841228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.854863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c0b56-b341-4379-ab2d-f8528f4f81ff admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.865388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.866414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.866697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.867014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.885008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.887218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.914276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:50.915882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 310/630] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:50.921349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.932702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a930b6-99b6-4cc0-a06c-1b9659522881 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.941556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.942671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.943177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.943671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.944654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:50.945191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.947313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:50.962977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 321/631] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:50.968503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:50.978569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad33e-b259-42c2-b1a1-fc1fbee13579 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:50.985990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:50.987019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:50.987284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:50.987550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:50.996115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:50.998235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.013170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:51.014692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 311/632] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.020842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.035504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb40f2-a68c-422d-91e7-82fb3b52fade admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.046311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.047338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.047758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.048170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.049269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.049718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.051810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26275019-eadc-4af2-aefd-af97d0f6ad18 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.071253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 322/633] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.077293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.100026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f1d6-a27e-4e39-bcb4-d030fe9f5468 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.107231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.108052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.108486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.108851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.109989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=86a45f34ca2b48e1ad61d3064715625f) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.110452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.112758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeac37-28c6-4b07-a425-4bcad300cc73 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.132235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 312/634] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/role_assignments?user.id=86a45f34ca2b48e1ad61d3064715625f&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.201110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9cbc-5a9a-475e-a9c7-5670e9f6d4c9 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.201378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9cbc-5a9a-475e-a9c7-5670e9f6d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.201656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9cbc-5a9a-475e-a9c7-5670e9f6d4c9 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.203926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 323/635] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:51.210185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.210502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.210780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.240804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:51.242045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:51.258393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 313/636] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:51.277202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9cbc-5a9a-475e-a9c7-5670e9f6d4c9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.290533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9cbc-5a9a-475e-a9c7-5670e9f6d4c9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.295201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.296108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.296443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.296716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.310108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:51.318175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:51.319653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 324/637] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.325579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.334954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61ca05-7c77-4a09-84e4-7abab5deb3a6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.339639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.340326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.340603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.340874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.341645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.342001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.343680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2991f-844a-4d91-be12-6257fd8b1de0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.354327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 314/638] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.359573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.370994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e040b-4028-4c23-9586-db6eedaa45e6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.375899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.376716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.377581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.377852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.389953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.391958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.406838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9763e-0742-499f-9227-3426141aed78 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.407471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9763e-0742-499f-9227-3426141aed78 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.407994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9763e-0742-499f-9227-3426141aed78 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.414171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:51.414714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 315/640] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:51.416240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.416735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.417195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.417475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 325/640] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.418696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.429653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3a64-516e-456e-893c-505198955d74 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.438233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.438233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.438233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.438233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.438639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.438639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.438962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65566e5b-2cc3-4086-bf39-b3f4145f3a09 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.447952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:51.449511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:51.458225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 326/641] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:51.460271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f581b1c-07c0-440e-96d8-6cfaa31d5b1e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.460974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 316/642] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:51.461449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f581b1c-07c0-440e-96d8-6cfaa31d5b1e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.462046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f581b1c-07c0-440e-96d8-6cfaa31d5b1e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.464804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 327/643] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:51.467436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.470189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.470853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.471333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.480589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbdac7-968a-4ca7-8948-a96992a8f7b0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.490704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.491564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.491790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.492060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.494457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:51.495970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:51.499921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.504301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.507212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 328/644] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:51.508343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.519997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080d569-0973-4059-a6e7-9d6379e1e550 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.523469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 11:16:51.528931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 317/645] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.529082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.529082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.529082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.529082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.531879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.542444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ce06-7f25-4b71-8f5a-8be6565bad93 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.546338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:51.547952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.549178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.549433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.549802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.550805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.551209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.553173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.553517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:51.555083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 329/646] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.555858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.571018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a986b70-3876-4c5b-a2d9-648695796307 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.578331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 318/647] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:51.579573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.581620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.582444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.582727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.583001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.595844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df0be4-6071-49ae-a0d4-e369a337f839 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.596551 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:51.603399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.603744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:51.604444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.604848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.605210 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 330/648] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.605308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.606021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.606497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.606961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.609330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.619538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687508e3-e982-49f4-a4bd-008da0510e99 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.620945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 319/649] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.621400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.624573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.625558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.626084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.626354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.632198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e82796-7091-472e-87f4-cba31b9a917c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.639105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.639257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.639857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.640133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.640398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.641040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.641145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.641460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.644119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.654670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 320/650] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.655533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.665236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4883bb-97fa-4a28-8dcc-cfbd12b7ef10 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.668918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:51.670238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.670506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 331/651] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.671215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.671348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.671668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.672097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.683887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.684218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429a7d1-95f5-427d-a64f-a2bff85d6d83 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.686056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.689785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.690623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.690903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.691177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.703562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.705405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:51.705527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.707113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 321/652] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.708034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.719155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e4a21-7349-4dea-9c8f-887218f900cd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.724810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.725564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.725997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.726476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.727304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.727751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.729549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.730003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:51.731620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 332/653] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.733088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.746942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 322/654] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.747155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1e8d-8976-423e-8b60-112bbfd5a8db admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.758235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.759220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f456ab-c75c-43a1-8167-4126d545bd9a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.759482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.760410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.760696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.760975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.761915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.762247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.764310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.765548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.766577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.767089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.767641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.768493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.768909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.770732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.781977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 333/655] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.783884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.785875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 323/656] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.791786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.795677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5277fdf-0738-4f84-b73e-e4ccc28c6eae admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.804187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712449eb-a0bd-48e5-9672-dc187e2a420e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.807683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.808645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.809407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.810311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.813462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.815069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.815508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.815922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.821054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.823228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.825346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.827631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.837499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:51.838938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 334/657] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.839796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.842779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 11:16:51.844225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 324/658] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.845725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.855941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb3b-3ed5-4a54-b8cd-d69a174ad4f8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.856417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f60760-c4b5-4e3b-a1cf-2397a513b5f6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.861171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.861432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.862134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.862511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.862647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.862920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.863227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.863739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.864747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.865198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.867269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.871407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.873572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.881573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 325/659] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.882616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.889272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 11:16:51.890760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 335/660] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:51.893000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb62baf-b9bd-49df-ac6b-ffdcdefa0ff1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.895056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.897885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.898750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.899190 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.899605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.900591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.901037 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.903042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.906470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72987ef-c0aa-432b-bece-a90c1a153aeb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.911208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.912234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.912579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.912926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/bccfc902f07f4298afeba04f08176891/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.929023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 326/661] 10.222.0.20 () {56 vars in 1160 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.930063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.935792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=bccfc902f07f4298afeba04f08176891, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.940048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.941106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019df124-a65a-40ab-a603-399c341174c2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.946502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.947289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.947645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.948040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.948960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:51.949338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.951317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:51.969531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 327/662] 10.222.0.20 () {56 vars in 1158 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:51.971653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:51.981286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8514e-bcb9-4fd4-bd65-fa40a61a313a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:51.985992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:51.986604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:51.986881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:51.987153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:51.995110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:51.996868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.006243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 328/663] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:52.011072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.020317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab00d-21ef-431b-b377-0e6280ad6489 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.024733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.025368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.025647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.025920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.034805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.036567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.045586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 329/664] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:52.050145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.059224 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d582f3-7685-418e-be8b-d0d60dcd6a08 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.063744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.064652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.064996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.065342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.075881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.077859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.092787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 336/665] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:51 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/bccfc902f07f4298afeba04f08176891/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:52.092787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.112201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:52.122579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 330/666] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:52.129947 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.145445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374adc3a-6fe4-43e6-8bac-b239f0d77a51 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.210139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11ce0-39a9-4b3e-9b81-d85e40414c2e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.220934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.222312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.224131 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.224486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.243611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.246394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.268911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.269615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.269961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.270327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.271139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:52.271522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.273254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.287606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:52.289726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 337/667] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:52.295440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.304521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 331/668] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:52.305183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46409996-99d3-453d-9ec5-837ed65bd570 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.309979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.310689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.310965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.311235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.311478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.311996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:52.312271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.314536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.327407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 338/669] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:52.329511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb66702-f6d3-4d94-9a95-09e3eae644b5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.333074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.334660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.335613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.335997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.336366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.344240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.347526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.356779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d1a9c-fa02-49db-b6bb-db730e7661fb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.363260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:52.364677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 332/670] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:52.371456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.379370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.379816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.380094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.380366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.384708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace3ba1-dad7-4300-80b0-c605795a8c61 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.390344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.391547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.392401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.392862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.393859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:52.394405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.395506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.396825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.397541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.412073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 333/671] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:52.418495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.422262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:52.426403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 339/672] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:52.430176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dcee6-b173-432d-88de-2659ec62ec76 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.433795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.435620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.436488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.436938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.437355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.438457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=dd7492ffb2a543979f94421c2649e5de) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:52.440058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.443079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.444384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2e43-ac58-439e-b728-0b5aefa07fb6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.449823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.450569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.450849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.451156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.451791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 334/673] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/role_assignments?user.id=dd7492ffb2a543979f94421c2649e5de&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:52.454918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:52.454918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.455119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ca599-6518-49ac-842e-113466bfc36f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.470109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 340/674] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:52.476430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:52.491596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8396f-5185-4483-a411-090d376cddf3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:52.510489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:52.511292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:52.511706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:52.512076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:52.513083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=a04d0effd2d54f28af90ede3c495a368) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:52.513475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:52.515551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e248f-b92b-4ac2-b839-69ff01cff1d1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:52.527615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 335/675] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:52 2022] GET /identity/v3/role_assignments?user.id=a04d0effd2d54f28af90ede3c495a368&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:53.635046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba18ff-fe29-451c-b6e8-a8992ce0e17e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.635901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba18ff-fe29-451c-b6e8-a8992ce0e17e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.636321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba18ff-fe29-451c-b6e8-a8992ce0e17e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.638791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 341/676] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:53.644908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.645824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.646278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.671353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:53.673464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:53.681490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 336/677] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:53.726376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba18ff-fe29-451c-b6e8-a8992ce0e17e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:53.744235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba18ff-fe29-451c-b6e8-a8992ce0e17e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:53.753837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:53.755158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.755678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.756159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.774597 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:53.782313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:53.786677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 342/678] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:53.792386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:53.805925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4a1f-fcd6-46ba-b620-dbe3e0e2253f None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:53.811205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:53.812142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.812623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.813714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.814747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:53.815254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:53.817040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:53.831417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 337/679] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:53.836757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:53.850886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b111-d8ed-48e1-82af-d0581f2740f9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:53.858841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:53.859954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.860454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.860949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.872148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:53.874518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:53.895657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:53.897196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 343/680] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:53.902746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:53.913669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22529fb7-0b5b-478f-8e45-afd9d173dfad admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:53.922943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:53.924054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.924535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.925028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.925964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:53.926493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:53.928379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:53.944050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 338/681] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:53.949205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:53.963424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05360f-0505-4873-8557-fac4cfca7c9c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:53.973341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:53.974493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:53.974990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:53.975492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:53.995526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:53.997959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.022727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:16:54.024676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 344/682] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:16:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:54.029811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.040313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0a93-4313-408b-a6cf-e6f15a33bdcf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.050673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.051705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.052198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.052723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.053791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:54.054337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.056432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b348310-21bc-4002-a83f-2cd3ca2c06e4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.081353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 339/683] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:54.087297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.098101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20275cfd-f4cd-4ca1-a93e-6e49d4cf1051 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.106577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.107570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.108085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.108592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.122242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.126537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f81f90-1be5-44f7-ad9b-2e63b9a73486 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.127079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f81f90-1be5-44f7-ad9b-2e63b9a73486 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.127562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f81f90-1be5-44f7-ad9b-2e63b9a73486 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.129573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 340/684] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:54.129955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.135335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.135620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.135897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.148071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 345/685] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:54.153670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.162290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:54.162290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:54.166829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6eb8-245a-4a11-a8a4-1fae97110fb1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.175844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.176629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.177437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.178640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.179362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 341/686] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:54.193221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.195094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.212487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:54.214005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 346/687] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:54.217736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.219455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.228997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baac93-6d4b-4899-b1fa-ca6db28770c8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.233895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.235558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.235878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.236048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ed2d6-2a4a-4258-8431-9e52b63a8da0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.236261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.246737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.247439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.247715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.247984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.249490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:54.249797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.253007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.256552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.258778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.277836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 347/688] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:54.283997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.293867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:54.303934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a9d5e-f06a-43f1-8561-d5396df8774e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.305259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 342/689] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:54.312481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.313954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.314268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.314594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.317053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.328077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846090a-facc-4ef0-9734-1f00014143e3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.336722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.337890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.338564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.338897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.339194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.339923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:54.340220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.341788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.343426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.369093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 343/690] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:54.369433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:54.370515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 348/691] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:54.380053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.382792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.395250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9738-2f69-4604-9087-ea50e8c75431 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.400554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014e067-33bc-4369-ae63-b114a7de9713 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.404021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.404672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.404962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.405216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.406533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:54.406950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.409001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.413557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff32b46-69f5-47be-b743-3380b6946d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.414243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32b46-69f5-47be-b743-3380b6946d1c admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.414517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32b46-69f5-47be-b743-3380b6946d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.414787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff32b46-69f5-47be-b743-3380b6946d1c admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.415506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff32b46-69f5-47be-b743-3380b6946d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.417402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff32b46-69f5-47be-b743-3380b6946d1c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.441440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 344/692] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:54.443640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:54.453954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c673875-39cf-4fc5-91d2-7a9461978b2d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:54.458749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:54.463664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:54.463664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:54.463664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:54.463664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=df05886e51f34628a524477b98227f40) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:54.463664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:54.464469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae5e1b-bf99-4863-9af5-6ab5d5ea71df admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:54.474376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 345/693] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:54 2022] GET /identity/v3/role_assignments?user.id=df05886e51f34628a524477b98227f40&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:54.529461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 349/694] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:16:54 2022] POST /identity/v3/users => generated 254 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:55.282522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47638347-346f-471c-b7a1-cafbcc367ff8 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.283557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47638347-346f-471c-b7a1-cafbcc367ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.284053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47638347-346f-471c-b7a1-cafbcc367ff8 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.286364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 346/695] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:55.291718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.292158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.292258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.314387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:55.315594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:55.326149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 350/696] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:55.353446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47638347-346f-471c-b7a1-cafbcc367ff8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.372356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47638347-346f-471c-b7a1-cafbcc367ff8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.382845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.384047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.384557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.385042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.399508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:55.407450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:55.409274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 347/697] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:55.414926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.432678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cb600-e651-4117-ade3-63fac0274602 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.446952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.447725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.448011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.448286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.449064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.449372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.451009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0205d6-47cd-46eb-80ab-70fb48e2ab7c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.464706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 351/698] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:55.470843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.490942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a341c1-b12b-482e-8d76-6be521c8da7f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.497820 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.498679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.498960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.499229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.518740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.520590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.543768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:55.545103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 348/699] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:55.550884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0216cae-a4e6-48ee-b75f-59d047c145c5 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.551166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0216cae-a4e6-48ee-b75f-59d047c145c5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.551440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0216cae-a4e6-48ee-b75f-59d047c145c5 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.553476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 352/700] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:55.555839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.559708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.559995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.560270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.567855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388b2c3-82fc-4624-8c43-aecb6e6f4761 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.578588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.579304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.579579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.579847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.582050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.582413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.586550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.594588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:55.597384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:55.612579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 349/701] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:55.614870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 353/702] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:55.617280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.631296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e926b9-b85b-494c-98a2-ea1ca2b4fa69 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.633493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.634140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.636930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.636930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.647643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.649781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.653885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.663705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7b5f-4908-4632-9a04-405d767a3bcb None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.676266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.679595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.679921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.680193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.680869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.683289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:55.683289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:55.683289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:55.684279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 11:16:55.685120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.690241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 350/703] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:55.691204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.709460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-09532c17-e195-491b-a55c-5f82f06974e8 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 11:16:55.710772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 354/704] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/services/network => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:55.711413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28c8f-1592-4692-970e-bf7dcbbd89d1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.712042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7848a-835f-4b07-9e70-d3cff48d1f8e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.712327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7848a-835f-4b07-9e70-d3cff48d1f8e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.712603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7848a-835f-4b07-9e70-d3cff48d1f8e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.714855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 355/705] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:55.719568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7848a-835f-4b07-9e70-d3cff48d1f8e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.721256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.722043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.722352 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.722693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.723569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.723876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.725735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b562-53ae-4abc-b271-f54bb127441a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.732625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7848a-835f-4b07-9e70-d3cff48d1f8e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.737154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.737795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.738071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.738373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.739095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.739398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.740409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:55.740409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:55.740409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:55.741848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.746115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 351/707] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:55.746286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 356/707] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:55.747564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.747858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.748124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.751275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.761614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05464835-46c2-4420-b22e-3383e1f9a95b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.769558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:55.770757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:55.772134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.773297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.773826 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.774427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.779145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 352/708] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:55.784925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.794317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2b68-4118-4b7e-b288-61e48cc45efd None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.794683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.797021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.804244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.804909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.805344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.805594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.806346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] RBAC: Adding query filter params (type=network) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.806647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.809333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:55.809333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:55.809333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:55.810244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.817013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 353/709] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:55.817837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.826941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 357/710] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:55.828954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c513-8bde-415f-a4fc-ea8576f320cc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.833018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.833483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.834315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.834584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.834855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.835510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.836532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:55.836532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:55.836532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:55.837391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.846864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7e9b-be3c-45e8-80c7-da4c5ac467ec admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.851490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 11:16:55.852735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 354/711] 10.222.0.20 () {56 vars in 1150 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:55.853288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.854430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.854939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.855501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.858804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.869564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e608ee7-b977-44f2-a00c-afb1c6145b54 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.871194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.873828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.874334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.875039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.875362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.875587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.876356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.876653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.878514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.883956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 355/712] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:55.889489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.896161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:55.898876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 358/713] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:55.900435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fdcb2-e482-4267-b136-6def3f2e3dbc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.906267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:55.914691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.915595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.915981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.917866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.918880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.920586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.923382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.931888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1019c-bda4-4bf4-8378-3b541df2191f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:55.935650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 356/714] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:55.947029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:55.947821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:55.948112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:55.948388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:55.949145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:55.949448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:55.951123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:55.976703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 359/715] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:55.982378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:56.000531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb65841-627d-4f13-b1d2-589f1f319315 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:56.010603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:56.011421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:56.011699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:56.011972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:56.024305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:56.026314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:56.046168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:56.047554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 357/716] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:56.053479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:56.068517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c46dd-847b-4168-93c3-2aabd7417de3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:56.083115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:56.083795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:56.084074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:56.084346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:56.085167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:56.085473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:56.087423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ce5a-1982-49ee-8e4f-09426871194d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:56.109041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 360/717] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:56.114652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:56.132145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845cb0d-f010-40de-b834-74cb978968e4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:56.148024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:56.148699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:56.148977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:56.149250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:56.150109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=bccfc902f07f4298afeba04f08176891) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:56.150448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:56.152356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83611e96-5839-4965-8355-cac5d0acfa4e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:56.161992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 358/718] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:56 2022] GET /identity/v3/role_assignments?user.id=bccfc902f07f4298afeba04f08176891&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:57.322188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3951-0b17-4fd6-a70d-9e834b3f57e4 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.322799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3951-0b17-4fd6-a70d-9e834b3f57e4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.322799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3951-0b17-4fd6-a70d-9e834b3f57e4 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.324822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 361/719] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:57.330818 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.331325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.331564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.349942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:57.351183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:57.360016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 359/720] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:57.385702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3951-0b17-4fd6-a70d-9e834b3f57e4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.398239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3951-0b17-4fd6-a70d-9e834b3f57e4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.402771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.403589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.403871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.404145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.431463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:57.438761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:16:57.440311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 362/721] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:57.446078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.455990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c003e5-febb-454e-a700-8db04f300f30 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.460665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.461330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.461611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.461903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.462758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:57.463114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.464725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.474714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 360/722] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:57.480136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.495950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca924c3-4663-4c43-a715-54e2551ce48c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.505992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.506819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.507103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.507380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.523657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.525514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.547450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:57.548671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 363/723] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:57.554118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.567775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a458d76-0424-4989-af0f-b4f331a164d0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.572443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.573042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.573327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.573602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.574378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:57.574686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.576282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.589132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 361/724] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:57.595062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.605053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c942de5-aea5-4561-a74c-b526655d39e6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.610629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.611518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.611804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.612081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.629851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.630263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.652036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:16:57.653558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 364/725] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:57.659979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.670975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71441996-3a66-429a-8b8b-492505549192 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.676423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.677112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.677484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.677768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.678677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:57.678988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.680985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.700086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 362/726] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:57.705510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.724577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3984-f11c-4264-925c-e65c0f03d733 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.729300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.730092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.730446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.730718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.742468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.744326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.763717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:57.766049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 365/727] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:57.771471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.781714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7f96d-d31e-41ca-ae69-abc21397cb78 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.786639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.789409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.789409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.789409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.789409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:57.789409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.790733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.803364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 363/728] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:57.808918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.819853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b46c0-5e63-4a01-a225-6edbe04371a4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.824520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.825334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.825613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.825886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.835264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.837288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.851311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:57.852831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 366/729] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:57.859277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.869332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713d07-961b-4a9e-8fbe-5118bfd8389d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.875210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.875863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.876142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.876462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.877256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:57.877649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.879644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14860-2c07-472c-b9ad-ec7afca90385 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:57.897691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 364/730] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:57.903413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:57.914462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09a5b-f1cb-469d-b87e-de1715ea914e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:57.919054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9be7e-7e1e-4925-a89d-db79a884e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:57.919979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9be7e-7e1e-4925-a89d-db79a884e247 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:57.920833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9be7e-7e1e-4925-a89d-db79a884e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:57.921104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9be7e-7e1e-4925-a89d-db79a884e247 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/df05886e51f34628a524477b98227f40/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:57.923196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9be7e-7e1e-4925-a89d-db79a884e247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=df05886e51f34628a524477b98227f40, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:57.925965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9be7e-7e1e-4925-a89d-db79a884e247 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.008779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 367/731] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:16:57 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/df05886e51f34628a524477b98227f40/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:16:58.075824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47def6-b16e-45a2-a8c4-5e27b3a93d37 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.076146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47def6-b16e-45a2-a8c4-5e27b3a93d37 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.076906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47def6-b16e-45a2-a8c4-5e27b3a93d37 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.079180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 365/732] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:58.084839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.085151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.085390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.109430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:58.110708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:58.202911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 368/733] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 11:16:58.243881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47def6-b16e-45a2-a8c4-5e27b3a93d37 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.261404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47def6-b16e-45a2-a8c4-5e27b3a93d37 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.267137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.268061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.268491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.268774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.290118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:16:58.298291 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:16:58.300358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 366/734] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:58.310779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.322097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a569cd4-13c1-4c2e-86c1-a35f1580fc84 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.339946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.340576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.340869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.341071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.342405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:58.342716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.344333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.359259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 369/735] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:58.365774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.376925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145bde-b158-4609-b605-2b5522e2c85f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.384242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.385044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.385315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.385586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.397529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.399522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.417319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:58.418908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 367/736] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:58.425247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.436195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fda46-12c0-4a7a-95c9-ad1111503853 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.441102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.441991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.442521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.442963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.443935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:58.444428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.446414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.464766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 370/737] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:58.470970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.487871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcf7fd-d175-4298-8ba0-8e68da8cde6b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.498807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.505814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.506314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.506772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.518560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.520951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.539721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 11:16:58.541287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 368/738] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:58.547487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.557822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b21f15-a12c-4e1c-9ba4-aca1aaa71482 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.566574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.567590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.568053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.568547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.569735 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:58.570296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.572503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.597764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 371/739] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:58.603653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.615326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098479-da17-4fa5-bebd-099cff99a2ae admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.626806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.627723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.628175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.628637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.643329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.645449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.660501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 369/740] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:16:58.666098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.676364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e57f1-0bac-4598-9a6c-462cf9921d16 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.686704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.687855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.688312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.688763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.700003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.703030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.728324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-a990a316-8aa3-4e50-bd7a-ce649831570e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:16:58.730233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 372/741] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:16:58.739363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.749816 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e32e4-6f1e-411b-a3ab-d9e3d63f7469 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.759687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69badc-3245-4501-b215-ab8b834b5214 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.759971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69badc-3245-4501-b215-ab8b834b5214 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.760302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69badc-3245-4501-b215-ab8b834b5214 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.760649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.761504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.761968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.762424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 373/742] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:16:58.762719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.764497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:58.764980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.766786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.768230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.768517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.768793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.792958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:58.794640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:58.800747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 370/743] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:58.804530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.812642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 374/744] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 11:16:58.824388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4b8c4-6a66-47ea-9bdc-60e5ad52dc8f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.835803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.837533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.842874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.843160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.843437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.848260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878f5c2-28a2-4d61-8b4a-7738c97f3f30 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.851853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.853246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.854032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.854357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.854863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.855328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.856257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.857543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:58.857543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:16:58.857543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:16:58.858823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141f5d-1c02-46e1-97fe-413455ebf4ba admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.868781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:16:58.868781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 371/745] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:16:58.874670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.885462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6dc87-8252-4b0e-8b34-f94feea9bc10 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.890748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.891510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.891860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.892198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.893059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:58.893420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.895540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.908584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 372/746] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:16:58.914561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:58.924451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e7f0-7703-4b67-85e6-4fcfc14a29ad admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:58.929350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:58.930039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:58.930374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:58.930693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:58.931526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:16:58.931881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:58.933837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6222a-b68b-4ce3-8046-fe9cbbc1b7b8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:58.939900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 373/747] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:16:58 2022] GET /identity/v3/role_assignments?user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:16:58.977089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 375/748] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:16:58 2022] POST /identity/v3/services => generated 240 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:16:59.264212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779849e2-692a-40a1-a351-ada1dc046a29 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:59.264775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779849e2-692a-40a1-a351-ada1dc046a29 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:59.265283 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779849e2-692a-40a1-a351-ada1dc046a29 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:59.267697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 374/749] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:59.273293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f71006-d13e-47e3-acea-bd94bc01e1f6 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:59.273641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f71006-d13e-47e3-acea-bd94bc01e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:59.273847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f71006-d13e-47e3-acea-bd94bc01e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:59.298483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-57f71006-d13e-47e3-acea-bd94bc01e1f6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:59.299704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-57f71006-d13e-47e3-acea-bd94bc01e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:59.337801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 376/750] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:59 2022] POST /identity/v3/auth/tokens => generated 1013 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:16:59.363903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779849e2-692a-40a1-a351-ada1dc046a29 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:59.378836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779849e2-692a-40a1-a351-ada1dc046a29 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:59.384394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:59.385327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:59.385825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:59.386334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:59.387280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:16:59.389423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:16:59.389423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:16:59.389423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:16:59.390663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497d79-7fb8-4d62-8eda-89631fc68581 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:16:59.520248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 375/751] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:16:59 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:16:59.877990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f23c1-2d07-4c5b-b445-f2d93ce12120 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:59.878499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f23c1-2d07-4c5b-b445-f2d93ce12120 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:59.878499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f23c1-2d07-4c5b-b445-f2d93ce12120 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:59.880788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 377/752] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:16:59.886097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:59.886409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:59.886680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:59.910622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:16:59.911842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:16:59.933793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 376/753] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:16:59 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:16:59.960772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f23c1-2d07-4c5b-b445-f2d93ce12120 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:16:59.974908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f23c1-2d07-4c5b-b445-f2d93ce12120 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:16:59.979294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:16:59.980103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:16:59.980384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:16:59.980680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:16:59.993244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:00.001495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:00.003074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 378/754] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:00.008813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.020134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a92a5-bcb1-44f6-8f31-1513458b3cd8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.025957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.026677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.026957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.027228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.027990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:00.028292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.029971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.039645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 377/755] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:00.045245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.055684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53acbc9-3966-4daf-9df2-853998d19b0a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.060974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.061753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.062034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.062346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.072972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.074866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.092717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:00.094260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 379/756] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:00.100006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.110800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030bdd3-1046-4614-bf53-2fa71a453cb2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.115412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.116119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.116397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.116670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.117459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:00.117765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.119509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.134016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 378/757] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:00.139606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.149584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca701f-f62b-4f05-94e9-4eee73472ead admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.154376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.155158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.155492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.155765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.163716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.165797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.180524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 11:17:00.182024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 380/758] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:00.187765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.200899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d2ce-34b3-4205-9438-9748daa390cd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.206299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.207014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.207293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.207566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.208472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:00.208776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.210703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.237163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 379/759] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:00.242655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.253612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4c82a-3bfb-472b-b365-bc97d1be29cc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.260259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.260904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.261182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.261451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.277984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.280516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.296767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 381/760] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:00.302257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.315425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454d953-539c-4f6b-aa95-4e87ab58d29b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.322702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.323539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.323817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.324088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.340298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.342801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.369060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:00.370459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 380/761] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:00.376088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.391882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440fe1b-dd71-4c1f-b7dd-4c14248f1a8f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.399055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.399707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.399988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.400258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.400988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:00.401288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.402894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.420392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 382/762] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:00.425457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.439596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93956f0e-5922-44fd-a7bb-e9c312fb4e4a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.450622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.450622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.450622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.450622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.458664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.460892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.479693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:00.492153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 381/763] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:00.497591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.520594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5384-e06d-486e-9c84-33c6693f1a56 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.536244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.536900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.537177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.537510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.538259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:00.538566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.540421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb811a-d450-470b-b80d-a3081022d6f1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.564507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 383/764] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:00.570031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:00.581557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dd317-ebfe-413b-8888-a725637b5fcd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:00.594668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:00.595788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:00.596275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:00.596757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:00.597805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=bccfc902f07f4298afeba04f08176891) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:00.598336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:00.600379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0905f1f-bb10-4427-a1af-c141263e900a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:00.614235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 382/765] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:00 2022] GET /identity/v3/role_assignments?user.id=bccfc902f07f4298afeba04f08176891&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:01.232250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d17f-9fb2-42da-9a10-327a45fa45fb None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.232781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d17f-9fb2-42da-9a10-327a45fa45fb None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.232781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d17f-9fb2-42da-9a10-327a45fa45fb None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.234988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 384/766] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:01.240239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.240527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.240807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.263634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:01.264842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:01.273061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 383/767] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:01 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:01.318751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d17f-9fb2-42da-9a10-327a45fa45fb None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.336328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d17f-9fb2-42da-9a10-327a45fa45fb None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.343739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.344536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.344815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.345087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.356299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:01.363305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:01.364816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 385/768] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:01.370537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.383930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c080d-fe58-4111-8ed8-db32cd9e02b3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.394913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.395594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.395871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.396145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.396914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:01.397216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.398861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.409005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 384/769] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:01.415587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.432702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696878c3-b556-431c-a2cf-38f6aff5822b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.440115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.440985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.441269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.441591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.461226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.463123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.484636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:01.484636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 386/770] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:01.490250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.508197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6cf91-8632-48dd-84f1-a1055bb8ffd5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.526952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.527668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.527975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.528289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.529141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:01.529452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.531089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.552707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 385/771] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:01.557711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.571668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36f1e-1f68-4f44-85fd-b4ece7c96f30 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.582913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.583758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.584040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.584312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.599059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.601108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.615473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:17:01.616827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 387/772] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:01.622901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.639977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d7fc8-e480-44ec-b223-d795723daa90 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.654870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.655550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.655829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.656102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.656956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:01.657264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.659149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.685987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 386/773] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:01.691155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.703707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6339-4150-4c41-a072-254ca97122da admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.714032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.714738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.715138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.716055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.730550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.731862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.745514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 388/774] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:01.751287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.768173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0963a6-cc0f-4b79-9866-6a649ae1f26c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.782902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.783709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.783988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.784262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.798271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.800135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.830986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-32042b4e-d194-4bb5-bc6e-4756828ca7b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:01.836832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 387/775] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:01.838193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.846477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96e30f-2269-4470-af19-a57dac149549 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.846817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96e30f-2269-4470-af19-a57dac149549 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.847026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96e30f-2269-4470-af19-a57dac149549 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.849328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 388/776] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:01.855695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.856020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.856225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8804a4-094c-497d-a02c-b4f1cade4fcc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.856391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.864751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.865423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.865702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.865976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.866747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:01.867050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.868652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.892878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:01.894074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:01.899768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 389/777] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:01.904084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.912423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 389/778] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:01 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:01.925894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389ee1e-ba34-4d53-907d-2c3cfd54f615 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:01.930450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:01.931239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:01.931516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:01.931791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:01.943425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:01.945413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:01.974261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:01.974261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 390/779] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:01.982471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.982774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:01.989104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687f23-c2ae-4f8f-bb2d-aaebc45075e8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.005522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.006282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.006568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.007084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022b7d0-b81d-4298-b3df-27ba4bb7d2f1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.007894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.016481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.017150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.017484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.017957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.018819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.019169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.020977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.023251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:02.031371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:17:02.033010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 390/780] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:02.042025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.046352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 391/781] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.052046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.062313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7113b-e3e5-4f87-a8fb-2f3513ca4a6a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.068272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1178a-2409-4b5c-95c6-27ac5b31c02f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.071136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.071811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.072091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.072366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.073131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.073437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.075653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.080725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.081390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.081669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.081948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.082827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=df05886e51f34628a524477b98227f40) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.083139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.084988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.095939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 392/782] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/role_assignments?user.id=df05886e51f34628a524477b98227f40&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:02.098138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 391/783] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.103869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.118090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d1c1-b85e-4a61-871d-4b046fd47f61 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.123847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.124668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.124950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.125224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.148207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.150118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.174069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:02.175778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 393/784] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:02.181332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.192070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52648147-cfe2-497e-ab15-fe49b567a3bc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.197071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.197813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.198098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.198399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.199527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.199734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.201333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.214667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 392/785] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.220998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.234068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6c732-fb67-4ca0-8354-43c44b0df224 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.238695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.239504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.239837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.240107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.254018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.256157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.276143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 11:17:02.278142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 394/786] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:02.283901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.300259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8bb5-06af-404c-bc02-e2c6cba7311e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.308277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.309731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.310076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.310378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.311250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.311602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.313568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.338308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 393/787] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.344471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.360473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62a6fe-9207-47d4-8c63-bbd11623afc9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.365213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.366028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.366333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.366610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.385742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.388386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.408952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-cf9d7f85-f4b5-4c31-b59c-a72b2734af22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:02.410161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 395/788] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:02.417300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.427742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11c47a-da0d-47bf-91b6-1692505034cc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.432387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.433102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.433383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.433844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.434946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.435265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.437039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.447442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f4c0-6f91-4732-ae81-c9a69cd5b75c None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.447442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f4c0-6f91-4732-ae81-c9a69cd5b75c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.447442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17f4c0-6f91-4732-ae81-c9a69cd5b75c None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.447442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 396/789] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:02.452709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 394/790] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.456979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.457271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.457530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.462727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.473992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427069e-9a6c-4846-bfe8-484e9bba48e8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.479265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:02.483918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:02.489653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.490497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.491034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.491034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.495816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 397/791] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:02 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:02.510877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.510877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.523079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:02.525516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 395/792] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:02.531637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.533558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.544950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886c653-f8e1-4099-b6ba-4a9f1f065913 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.546064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8b0e-d624-4b41-b5b1-15a4a1e8b9ef admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.550334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.551044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.551275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.551387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.551590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.552455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.552765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.552944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.553399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.553874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] PATH_INFO: `/v3/services/network` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.554706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.555010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.556827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.568900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 398/793] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.569772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 11:17:02.571424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 396/794] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:02.575213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.577574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.587453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1541a16-1e60-4f79-9f9c-e69b85c7a80f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.587627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5a8be-ee20-4019-835f-a2af8274bbc9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.592394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.592868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de262e5-a9db-411d-8dbe-9226bee5c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.593540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.593790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de262e5-a9db-411d-8dbe-9226bee5c4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.594076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de262e5-a9db-411d-8dbe-9226bee5c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.594388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de262e5-a9db-411d-8dbe-9226bee5c4e3 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b4b5d6a7bf664a98bb17f6fcbbca69bd/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.594657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.595162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.596063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.596553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.598469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.609826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 397/795] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.616864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.624390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de262e5-a9db-411d-8dbe-9226bee5c4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=b4b5d6a7bf664a98bb17f6fcbbca69bd, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.630078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de262e5-a9db-411d-8dbe-9226bee5c4e3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.630400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7e8b-b97a-494a-aaf4-24cc938acce0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.636311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.637528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.638081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.638594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.639573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.640124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.642160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.650353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 398/796] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.656667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.667250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387800b-3bc7-403d-82ea-15e5a3ea4661 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.672504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.673165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.673445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] RBAC: Adding query filter params (interface=public, service_id=5e224e54b54f4c589c426d30161ec968, region_id=RegionOne) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:17:02.677209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c09b6-b10c-46ca-af94-7bb47ccd11e0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.685702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 399/797] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/endpoints?service_id=5e224e54b54f4c589c426d30161ec968&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:02.687759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f7783-f5f0-400a-a176-ba34e727204a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.688049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f7783-f5f0-400a-a176-ba34e727204a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.688325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f7783-f5f0-400a-a176-ba34e727204a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.690200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 400/798] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:17:02.690965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f7783-f5f0-400a-a176-ba34e727204a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.701557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 399/799] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:17:02 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b4b5d6a7bf664a98bb17f6fcbbca69bd/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:17:02.702879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.703171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.705226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.723511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:02.724870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:02.801231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f7783-f5f0-400a-a176-ba34e727204a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.806342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.807494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.808046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.808970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.809674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.811624 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.818498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 401/800] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services => generated 772 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.830466 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 400/801] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:02 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:02.879695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.892504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f57d-2b00-453f-b7ee-38b5201f9a7a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.903456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.904384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.904667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.904926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.905643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.907394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.925192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 11:17:02.931464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 402/802] 10.222.0.20 () {56 vars in 1150 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:02.932889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.949696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0c92f-e941-4c71-90f7-ad6cbe81b48c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:02.963149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:02.963851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:02.964140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:02.964419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:02.965926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:02.966279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:02.967986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:02.973691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 401/803] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:02.979826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:02.996345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36117e4f-ed9f-49fd-819e-f2de458acb21 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:03.006905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:03.008089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:03.008640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:03.009116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:03.010171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:03.010737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:03.013294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:03.023131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 403/804] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Jan 10 11:17:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:03.031422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:03.049160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807362-72fe-42b3-9092-b40d669ef50a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:03.058789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:03.059470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:03.059754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:03.060034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:03.060860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] RBAC: Adding query filter params (interface=public, service_id=034e48d34c924205b2314c5c2c01cc9a, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:03.061174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:03.062206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:17:03.062206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:17:03.062206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:17:03.063126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1dcb-a1ed-47f5-9a86-28fb3b45bc60 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:03.077853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 402/805] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:03 2022] GET /identity/v3/endpoints?service_id=034e48d34c924205b2314c5c2c01cc9a&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:03.083703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:03.096238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923bd26-8720-4f07-b918-9d0331806fd4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:03.102252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea188b-36be-45e1-8cdd-4f59a267d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:03.103307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea188b-36be-45e1-8cdd-4f59a267d6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:03.103787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea188b-36be-45e1-8cdd-4f59a267d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:03.104330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea188b-36be-45e1-8cdd-4f59a267d6ec admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:03.105889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea188b-36be-45e1-8cdd-4f59a267d6ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:03.107865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea188b-36be-45e1-8cdd-4f59a267d6ec admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:03.116046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 404/806] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:03 2022] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:03.943559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984668-5c96-4c22-b3ec-c01e68d9aca8 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:03.944066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984668-5c96-4c22-b3ec-c01e68d9aca8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:03.944344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984668-5c96-4c22-b3ec-c01e68d9aca8 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:03.946624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 403/807] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:03.952448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:03.952905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:03.952979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:03.971364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:03.972559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:03.981510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 405/808] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:03 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:04.007005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984668-5c96-4c22-b3ec-c01e68d9aca8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.023464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984668-5c96-4c22-b3ec-c01e68d9aca8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.028223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.029008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.029289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.029562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.045957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:04.052982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:04.054493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 404/809] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:04.061079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.070065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaa742-25e6-403c-ae46-857255e65646 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.074788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.075446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.075727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.075996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.076755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:04.077054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.078686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.087535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 406/810] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:04.093073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.102964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf3645-2bab-47bb-8cda-a4535b7dc709 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.108040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.108822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.109102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.109374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.124320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.126192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.154196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:04.155451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 405/811] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:04.161282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.173312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c487-13c1-4044-bdcd-315f927272f7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.182667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.184008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.184290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.184564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.185308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:04.185612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.187388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.206320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 407/812] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:04.212190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.228153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d573ba-29a3-4626-9359-08a909b44ea2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.235655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.236507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.236787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.237099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.253352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.255543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.278252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 11:17:04.280284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 406/813] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:04.285624 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.300615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd184d70-c93a-4506-b430-4a6f2710b598 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.322969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.323682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.324134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.324415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.325285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:04.325595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.327493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.347356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 408/814] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:04.352362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.367230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a6857-e9de-4313-a07a-1d2ef2a0436b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.383778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.384883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.385357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.385959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.403136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.405327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.430280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:04.432177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 407/815] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:04.438186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.456758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483981ef-8ad6-4b72-95c9-4a4010e25c65 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.464975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.465684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.465969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.466263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.467068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:04.467372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.469051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.490578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 409/816] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:04.496751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.513298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163edd8-1d4e-4945-b66b-9965d8739ed8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.522253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.523326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.523805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.524271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.531921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.538245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.552200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:04.553739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 408/817] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:04.560423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.575972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f3bd9-9866-49b7-9907-f5e232f68633 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.583847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.584560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.584842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.585116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.585981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:04.586319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.588229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713d7ef-9df1-463b-a54f-15bba626c77d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.612789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 410/818] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:04.618586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:04.638316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d20b56-7f53-4127-84c4-856dc6b51968 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:04.646674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c0cc2-449d-4fbe-905d-bd1d61bc9be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:04.647805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0cc2-449d-4fbe-905d-bd1d61bc9be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:04.648285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0cc2-449d-4fbe-905d-bd1d61bc9be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:04.648750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c0cc2-449d-4fbe-905d-bd1d61bc9be9 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/bccfc902f07f4298afeba04f08176891/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:04.650983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0cc2-449d-4fbe-905d-bd1d61bc9be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=bccfc902f07f4298afeba04f08176891, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:04.653859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c0cc2-449d-4fbe-905d-bd1d61bc9be9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:04.754339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 409/819] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:17:04 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/bccfc902f07f4298afeba04f08176891/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:17:05.351279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006c23-029d-45dd-ace5-30ade3dfc31d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.352004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006c23-029d-45dd-ace5-30ade3dfc31d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.352004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006c23-029d-45dd-ace5-30ade3dfc31d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.353897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 411/820] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:05.361169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.361839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.361839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.387503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:05.388736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:05.453323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 410/821] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:05 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:05.507244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006c23-029d-45dd-ace5-30ade3dfc31d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:05.524025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006c23-029d-45dd-ace5-30ade3dfc31d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:05.530143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:05.531021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.531298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.531568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.532297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:05.533955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:05.550235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 11:17:05.551749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 412/822] 10.222.0.20 () {56 vars in 1153 bytes} [Mon Jan 10 11:17:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:05.557307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:05.566799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cd267-923d-4a4a-9db4-e2d4babed384 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:05.575065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:05.575788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.576071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.576347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.577177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:05.577486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:05.579200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a5bf-57f9-42aa-8630-d0fde32cb0f3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:05.585455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 411/823] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:05.591378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:05.603208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f145d-e748-4d66-b4e4-81df71a389fd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:05.610310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:05.611075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.611360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.611715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.612451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:05.612759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:05.614433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d02fc-ab15-45ac-9ceb-38b1d9820a0f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:05.620719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 413/824] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:05.923743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32a79-eefe-4723-8140-5984f3227997 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.924142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32a79-eefe-4723-8140-5984f3227997 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.924342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf32a79-eefe-4723-8140-5984f3227997 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.926317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 412/825] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:05.944179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:05.944512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:05.944717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:05.971504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:05.972787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:05.981093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 414/826] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:05 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:06.007638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32a79-eefe-4723-8140-5984f3227997 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.024361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf32a79-eefe-4723-8140-5984f3227997 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.029068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db6a0-08d4-4f24-9864-72958530b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.029925 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db6a0-08d4-4f24-9864-72958530b1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.030221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db6a0-08d4-4f24-9864-72958530b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.030500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db6a0-08d4-4f24-9864-72958530b1ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.051419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685db6a0-08d4-4f24-9864-72958530b1ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:06.059230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-685db6a0-08d4-4f24-9864-72958530b1ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:17:06.060799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 413/827] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:06.066729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.076874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c329c-a199-42f6-89c2-439ebf49cfc8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.086091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.086798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.087082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.087359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.088168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.088498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.090199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.097667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583bbd-ae29-489b-9be5-59431f1cedb2 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.097979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583bbd-ae29-489b-9be5-59431f1cedb2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.098284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583bbd-ae29-489b-9be5-59431f1cedb2 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.101158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 414/828] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:06.103802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 415/829] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.107009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.107293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.107569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.113904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.121869 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068cd2-ce14-4c81-ac32-29b11262c77b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.128114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.130451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.130451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.130451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.139074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:06.140571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:06.143744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.146310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.149948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 415/830] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:06.176229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:06.179330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 416/831] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:06.180598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.193349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.199982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385a364-32a2-41e8-ab01-b909c806a6be None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.209387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.210249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.210537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.210812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] PATH_INFO: `/v3/services/network` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.211487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.214952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.215971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd953fc1-bedb-4d9d-a35d-ae0a9baaefa0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.225353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.227616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.227936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.228215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.230634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.231883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.233592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.239667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 11:17:06.246459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 416/832] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/services/network => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:06.259916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.260702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 417/833] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.270958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.275573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce7be3-41e0-4445-b768-161190e8dbef admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.283729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe8b48-3c48-4cb4-b879-df7917a486e8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.290193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.291553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.292341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.292628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.294309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.294629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.295459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.296317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.296589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.296858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.299274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.311987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.314829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 417/834] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.315046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.322013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.341690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4483-9d65-472a-aff2-620601479f0a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.350336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 11:17:06.352374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.353078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.353362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.354201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.354954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.355260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.357836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.358231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 418/835] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:06.367018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.375902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 418/836] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.381866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.390443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cbb16-9b7b-47a3-99c2-5e70cae44360 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.398854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.400703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.400987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.401282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.402053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371fe4b-3b80-4670-bcbb-b5620ca7446b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.403012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.403323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.406450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.413744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.414476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.414760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.415036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.415856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.419409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:17:06.419409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:17:06.419409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:17:06.421980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a55a83-6e32-4a15-9ccc-261ac6bbe146 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.444910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 419/837] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.450340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.461053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad7349-60ee-4442-adb5-c44686298caf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.466108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922825-917e-4d00-8a25-29ef40b43712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.466896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922825-917e-4d00-8a25-29ef40b43712 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.467181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922825-917e-4d00-8a25-29ef40b43712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.467454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922825-917e-4d00-8a25-29ef40b43712 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.477208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922825-917e-4d00-8a25-29ef40b43712 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.481070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922825-917e-4d00-8a25-29ef40b43712 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.491817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 420/838] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:17:06.496713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d0fbf-3037-4a82-b770-b61bf26efd87 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.497074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d0fbf-3037-4a82-b770-b61bf26efd87 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.497504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d0fbf-3037-4a82-b770-b61bf26efd87 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.499399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 421/839] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:06.500106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d0fbf-3037-4a82-b770-b61bf26efd87 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.515679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d0fbf-3037-4a82-b770-b61bf26efd87 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.520359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.526261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.526261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.526261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.533402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.535361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.551449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 419/840] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:17:06.557338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:06.559246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.559854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.560333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.566511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 422/841] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:06.568133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.591449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc5413-27ae-42c5-a3e9-1b580226f74e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.606776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:06.610655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:06.631173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.633903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.634501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.635026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.638126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 420/842] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:06 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:06.642927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.643228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.645105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.664695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 423/843] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.671057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.681063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb11c1-8d0d-492f-b13c-488b7ada49b5 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.690075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.690944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.691227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.691501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.699591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.701522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.720811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:06.726668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 421/844] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:06.728421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.745156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7021b01-91cd-47e6-9beb-ee5aaea7ff80 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.749891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.750593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.750875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.751147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.752220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.752526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.754473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.770031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.781491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766c1cd-2fd8-40ec-9efa-a38cfda5444e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.783441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 424/845] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.790444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.799187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.800250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.800495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.800775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.801458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.808305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.811114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604afc7-ba43-428c-8d5e-629661f15a8c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.817942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.818621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.818896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.819166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.820008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.820321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.822820 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.828683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 11:17:06.829712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 425/846] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/role_assignments?user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.830787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 422/847] 10.222.0.20 () {56 vars in 1150 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:06.836963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.848024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6645-4906-4754-8896-3e4c56d2b7ec admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.853015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.854181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.854499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.854775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.855529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.855828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.857571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.863296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 426/848] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.869874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.882285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e0f1-5dd1-4b6e-bdae-df6c9ee43233 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.888998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.890036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.890557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.891049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.892006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:06.892499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.894440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e044-5494-44b7-8f09-aa824345ef2c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:06.900792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 423/849] 10.222.0.20 () {56 vars in 1145 bytes} [Mon Jan 10 11:17:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:06.906917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:06.918510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c1885-b96d-4fb7-8daa-9f6dcbf1f768 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:06.923725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:06.924795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:06.925288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:06.925790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:06.926797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:06.928080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:17:06.928080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:17:06.928080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:17:06.929432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59ead-647b-4ad9-9b8a-292a8f40d0d2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:07.009217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 427/850] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:07.646892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4799-cef6-43bb-a1be-fc730a045ca5 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.648018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4799-cef6-43bb-a1be-fc730a045ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.648575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e4799-cef6-43bb-a1be-fc730a045ca5 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.651105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 424/851] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:07.656425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.656875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.657055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.675415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:07.676600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:07.694402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 428/852] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:07 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:07.720071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4799-cef6-43bb-a1be-fc730a045ca5 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:07.732819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e4799-cef6-43bb-a1be-fc730a045ca5 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:07.737168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:07.737941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.738241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.738524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.751857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:07.758788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:07.760278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 425/853] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:07.766151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:07.775526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a217f2-1e74-4a6e-85d1-5004d4e7e04f None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:07.780499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:07.781168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.781444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.781717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.782611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:07.782919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:07.784633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:07.795231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 429/854] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:07.800811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:07.812595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb606f-0af1-4a06-84e9-436ed6b93de8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:07.820262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:07.821115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.821393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.821747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.833194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:07.835107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:07.853383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:07.855263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 426/855] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:07.860954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:07.871898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e12719-e09e-4d8c-8d42-61b5a90cd256 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:07.877123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:07.877902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.878182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.878489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.879282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:07.879583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:07.881301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:07.894477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 430/856] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:07.899948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:07.910610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38682a-c596-44a7-94bc-6500df945a9d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:07.916875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:07.917822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.918116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.918465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.927204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:07.929477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:07.945697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 11:17:07.947806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 427/857] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:07.953352 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:07.963697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806bbcb-f930-4573-bc2e-dd46b5d9e22f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:07.968517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:07.969184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:07.969466 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:07.969779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:07.970676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:07.971021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:07.972955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:07.991932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 431/858] 10.222.0.20 () {56 vars in 1156 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:07.998077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.008392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037a513-459c-4aa2-8466-e9aa11573dc8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.013798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.014471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.014755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.015027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.023749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.026112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.036174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 428/859] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:07 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:08.042039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.052187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec99e-add2-45d9-b2fc-55363a60af3b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.057036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.057874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.058153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.058449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.069991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.071988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.091590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:08.093242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 432/860] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:08.099090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.109196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142811-aba6-40c4-b06d-50cf02ec52ad admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.114101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.114824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.115157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.115435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.116256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:08.116560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.118591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.131939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 429/861] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:08.137493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.147730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc40b1-2a31-4804-8333-1cf5af3a4339 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.152961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.153752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.154077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.154388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.162060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.164129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.179482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:08.181852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 433/862] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:08.186986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.197076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c39525-3946-4ffb-8f13-3f80c3c44dc0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.201732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.202470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.202754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.203084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.203898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:08.204256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.206163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c870c-da73-4ce3-b257-09aad2a9f1f9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.220143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 430/863] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:08.225990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.237660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b630-874b-47ee-baaa-9926c63f54c6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.242519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.243172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.243549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.243822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.244721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=bccfc902f07f4298afeba04f08176891) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:08.245089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.247072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dff262-a135-4ec1-91a8-130096bfb7c9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.254270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 434/864] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:08 2022] GET /identity/v3/role_assignments?user.id=bccfc902f07f4298afeba04f08176891&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:08.552384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d232-b827-4527-b8e6-c1d3ac407031 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.552711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d232-b827-4527-b8e6-c1d3ac407031 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.552930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600d232-b827-4527-b8e6-c1d3ac407031 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.554971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 431/865] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:08.560672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3596e-4505-4cfa-8f64-ba64568d793e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.560962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3596e-4505-4cfa-8f64-ba64568d793e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.561242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3596e-4505-4cfa-8f64-ba64568d793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.579629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-42c3596e-4505-4cfa-8f64-ba64568d793e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:08.580819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-42c3596e-4505-4cfa-8f64-ba64568d793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:08.589006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 435/866] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:08 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:08.613576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d232-b827-4527-b8e6-c1d3ac407031 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:08.626446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600d232-b827-4527-b8e6-c1d3ac407031 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:08.630942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01878794-166b-4551-941b-fd48446ed10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:08.631598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878794-166b-4551-941b-fd48446ed10b admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:08.631879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878794-166b-4551-941b-fd48446ed10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:08.632153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878794-166b-4551-941b-fd48446ed10b admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:08.632903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01878794-166b-4551-941b-fd48446ed10b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:08.635066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01878794-166b-4551-941b-fd48446ed10b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:08.734756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 432/867] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:08 2022] POST /identity/v3/services => generated 269 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:09.436337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139ad-4f3a-4910-9506-58bda28863d4 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.437069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139ad-4f3a-4910-9506-58bda28863d4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.437069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139ad-4f3a-4910-9506-58bda28863d4 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.439016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 436/868] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:09.444758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.445046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.445322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.465022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:09.466246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:09.490322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 433/869] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:09 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:09.510868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b139ad-4f3a-4910-9506-58bda28863d4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.523165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b139ad-4f3a-4910-9506-58bda28863d4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.528490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.529284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.529555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.529817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.540754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:09.548103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 11:17:09.554161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 437/870] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:09.556155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.565302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825ae1-af4c-481b-9b41-74cb8273d32b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.569929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.570632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.570936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.571416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.572267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:09.572572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.574180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.588584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 434/871] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:09.589939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.599666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5c6f9-2d5e-4c81-9b9b-1512e828dd16 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.605439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.606245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.606518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.606783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.618156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.620043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.637389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-fb6608bf-b592-4509-a4f0-fd7f99b53533 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:09.643346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 438/872] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:09.644703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.655197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e808c2f-f3a9-4c86-aa23-693b1a262184 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.659705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.660347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.660626 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.660934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.661615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:09.661914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.663539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.677035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 435/873] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:09.683132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572947ab-0870-4a79-86cf-8cb031b2eb71 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.683132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572947ab-0870-4a79-86cf-8cb031b2eb71 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.683132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572947ab-0870-4a79-86cf-8cb031b2eb71 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.683132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 439/874] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:09.683801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.692552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.692552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.692552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.695988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5c579-5812-454f-aebc-49d922852d58 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.701001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.701800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.702082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.702398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.710145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.712957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.714161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:09.715639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:09.730258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 11:17:09.730576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 440/876] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:09 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:09.733854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 436/876] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:09.735160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.745284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d6678-3692-4d04-be68-af3a3b168d30 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.750008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.751001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.751256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.751523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.751938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.752366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:09.752665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.754687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.765878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc7407-4fce-436b-9e1b-7f235adeb43b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.771406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.772715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.773226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.773722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.775159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.777010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.779401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 441/877] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:09.780765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.790743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf55414-b2d2-405b-9e93-5891a1c663dc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.791612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 11:17:09.793189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 437/878] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:09.798009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.798009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.798009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.798009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.799386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.806521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.808351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.811642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985b3a-cf04-42de-ac15-d9fddfa49652 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.817643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.818588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.819076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.819574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.820521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:09.821133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.823147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.824674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 442/879] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:17:09.826023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.829348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 438/880] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:09.835031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.835770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde0a1-8e58-4f6a-bec0-a1ab2395a664 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.840954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.841797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.842080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.842396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.847249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2d3fa-523a-4075-bd92-1f4fa372fe81 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.852156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.853145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.853613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.854069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.854610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.855208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:09.855712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.856778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.857704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.869196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 439/881] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:09.876185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:09.882467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 443/882] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:09.883973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.894527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21ff35-320c-4cfe-9319-cc694fc5d596 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.900179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.901217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.901675 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.902276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.903233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:09.903778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.905672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.924582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 440/883] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:09.926375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.937951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a02bb-5e72-4bce-8cc4-f40bf1b6db12 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.943484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.944640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.945093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.945593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:09.954560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:09.956923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:09.971986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:09.978377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 444/884] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:09.981184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:09.991540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd27695-5b41-4c81-9dc4-69ee31e952ae admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:09.997294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:09.998437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:09.998939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:09.999420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.000771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:10.001280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:10.003731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088a8f6-c5bb-4e61-a98a-63cfed75e3a0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:10.018786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 441/885] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:10.025959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:10.037497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5af08-42e2-48a8-a7c9-1e5aaa3b7bff admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:10.045566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:10.046631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:10.047172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:10.047618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.048823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] RBAC: Adding query filter params (role.id=7446d3c1ada747cbaea2c5a13209f7d1, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:10.049345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:10.051711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e40fa-4809-4bda-9555-04ab296ce3c0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:10.058841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 445/886] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:10 2022] GET /identity/v3/role_assignments?user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=7446d3c1ada747cbaea2c5a13209f7d1 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:10.791377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04517e-0998-4e86-809d-a792995cd962 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:10.791869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04517e-0998-4e86-809d-a792995cd962 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:10.791869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04517e-0998-4e86-809d-a792995cd962 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.794089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 442/887] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:10.801342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:10.801819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:10.801914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.821990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:10.823224 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:10.831435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 446/888] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:10 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:10.854668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04517e-0998-4e86-809d-a792995cd962 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:10.867232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04517e-0998-4e86-809d-a792995cd962 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:10.871699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:10.872494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:10.872772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:10.873042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.873713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:10.875803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:10.888048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 11:17:10.889650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 443/889] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:10.895885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:10.906276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12df62-d9fa-4347-a750-0a32148f00dd None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:10.911118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:10.911804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:10.912080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:10.912347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.913089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:10.913400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:10.915271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ce2c3-c71f-4128-b140-aea6ce28ac7d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:10.922375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 447/890] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:10.928171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:10.938376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d8ddb-e876-48a5-b51b-a366eb63f4b5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:10.943043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:10.943690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:10.944014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:10.944292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:10.945013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:10.945316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:10.947657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934d07c-6ccf-454a-9110-75177601fccc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:10.952848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 444/891] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:11.389328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea213ce9-3901-4435-92d7-d91c4190a202 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.389721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea213ce9-3901-4435-92d7-d91c4190a202 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.389893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea213ce9-3901-4435-92d7-d91c4190a202 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.391943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 448/892] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:11.397601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.397897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.398177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.417371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:11.418602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:11.426651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 445/893] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:11 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:11.453073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea213ce9-3901-4435-92d7-d91c4190a202 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:11.466015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea213ce9-3901-4435-92d7-d91c4190a202 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:11.470489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:11.471285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.471561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.471828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.472494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:11.474164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:11.487081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 11:17:11.488584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 449/894] 10.222.0.20 () {56 vars in 1153 bytes} [Mon Jan 10 11:17:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:11.495222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:11.510231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21118-8033-46ab-a66d-48de7770f99f None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:11.512651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:11.513312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.513596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.513873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.514629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:11.514939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:11.516544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:11.521801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 446/895] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:11.528742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:11.538691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e5d2-c42e-4a1e-a71a-fa7059a3f455 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:11.544110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:11.544857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.545141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.545465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.546185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:11.546568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:11.548222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:11.553409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 450/896] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:11.559726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:11.569805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ab406-a34f-42c8-9b3c-0539b940fd71 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:11.575240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:11.576142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.576648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.577126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.578143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] RBAC: Adding query filter params (interface=public, service_id=4b7e404223aa431b8c1df5292482d787, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:11.578651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:11.580395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621697c7-6998-4d45-b665-60a7a1b4ff0b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:11.586942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 447/897] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:11 2022] GET /identity/v3/endpoints?service_id=4b7e404223aa431b8c1df5292482d787&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:11.594277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:11.603015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae006325-cd7f-43b9-b0ad-740403a8f4be admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:11.607800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17bc19-4597-4108-a11f-6aed01bfa3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:11.608502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17bc19-4597-4108-a11f-6aed01bfa3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:11.608783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17bc19-4597-4108-a11f-6aed01bfa3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:11.609057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17bc19-4597-4108-a11f-6aed01bfa3d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:11.609800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17bc19-4597-4108-a11f-6aed01bfa3d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:11.611491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17bc19-4597-4108-a11f-6aed01bfa3d4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:11.618240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 451/898] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:11 2022] GET /identity/v3/services => generated 1029 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:17:12.468525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9b82-8622-497a-8b20-f612f765936d None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.469047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9b82-8622-497a-8b20-f612f765936d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.469125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9b82-8622-497a-8b20-f612f765936d None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.471187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 448/899] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:12.476977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb75e3c-d878-46c7-bac4-4501b17fc97d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.477419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb75e3c-d878-46c7-bac4-4501b17fc97d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.477511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb75e3c-d878-46c7-bac4-4501b17fc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.495611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4eb75e3c-d878-46c7-bac4-4501b17fc97d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:12.496812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4eb75e3c-d878-46c7-bac4-4501b17fc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:12.505728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 452/900] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:12 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:12.532559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c9b82-8622-497a-8b20-f612f765936d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.545810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c9b82-8622-497a-8b20-f612f765936d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.550459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.551113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.551396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.551673 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.552422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.554079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.561560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f14aac-e24d-4b79-916c-8e146d3a202c None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.561850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f14aac-e24d-4b79-916c-8e146d3a202c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.562124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f14aac-e24d-4b79-916c-8e146d3a202c None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.564239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 453/901] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:17:12.569366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.577625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.577625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.589940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:12.591182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:12.599899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 454/902] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:12 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:12.624401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.634708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468770d-9d44-4e04-9ec6-43e265c9e168 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.639146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.639950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.640232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.640512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.654556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:12.656821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 449/903] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:12 2022] POST /identity/v3/services => generated 251 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:12.663494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 11:17:12.670392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 455/904] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:12.672228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.697711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49146b4-abf3-4f61-8c04-44eed31b45e2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.715547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.716588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.717085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.717572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.718705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:12.719230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.721217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.736891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 450/905] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:12.738750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.751306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa4e59-48a0-4fcd-8eca-3400d8060874 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.756616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.758579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.759063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.759604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.772626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.775055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.793679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:12.800095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 456/906] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:12.801960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.813752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af376411-972f-4448-8438-d5b800b13ccc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.818953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.820520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.821253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.821748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.822702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:12.823218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.825043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.839457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 451/907] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:12.845788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.856690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecfb34-21cf-4a69-9a24-c9e66d39f143 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.861914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.863192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.863671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.864154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.876540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.879048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.895523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 11:17:12.901901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 457/908] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:12.903551 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.914927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef0506-9d7b-4c49-bab1-aae1bc8763d6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.919394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.920045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.920322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.920593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.921435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:12.921737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.923639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.943613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 452/909] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:12.948099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:12.957953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9efcf2-9b87-4808-ba8f-44ae172781ca admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:12.962873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:12.963663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:12.963945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:12.964216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:12.977103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:12.978930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:12.996433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:12.998052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 458/910] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:13.004463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:13.016337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49580dd0-76e1-41a8-87b0-8fb08cbd16bb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:13.021608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:13.022815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.024032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.024515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.025535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:13.026079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:13.028070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:13.045484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 453/911] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:13.047185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:13.057610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655daba-cd30-4cbb-a14e-cbd9b8598b58 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:13.062669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:13.063740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.064236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.064748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.073287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:13.075618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:13.090414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:13.096391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 459/912] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:13.098425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:13.109685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44497e-31cb-4960-9128-3f2ca4b062d9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:13.114787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:13.115672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.116201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.117280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.118548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:13.119053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:13.121150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dca9ca-6a6f-4a3a-9ecf-8b2d153eab99 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:13.139833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 454/913] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:13.141459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:13.152075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee07280-391e-4817-b2a6-27cc4a9e7cde admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:13.157043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27240d11-9166-46a5-ae76-ad9cf417bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:13.158250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27240d11-9166-46a5-ae76-ad9cf417bfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.158777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27240d11-9166-46a5-ae76-ad9cf417bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.159283 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27240d11-9166-46a5-ae76-ad9cf417bfc0 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b4b5d6a7bf664a98bb17f6fcbbca69bd/roles/7446d3c1ada747cbaea2c5a13209f7d1` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.161812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27240d11-9166-46a5-ae76-ad9cf417bfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=b4b5d6a7bf664a98bb17f6fcbbca69bd, role_id=7446d3c1ada747cbaea2c5a13209f7d1)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:13.165356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27240d11-9166-46a5-ae76-ad9cf417bfc0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:13.238563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 460/914] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:17:13 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b4b5d6a7bf664a98bb17f6fcbbca69bd/roles/7446d3c1ada747cbaea2c5a13209f7d1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:17:13.496904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5e33-5288-4848-af11-d7aed65f61b0 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.497872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5e33-5288-4848-af11-d7aed65f61b0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.498435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5e33-5288-4848-af11-d7aed65f61b0 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.501056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 455/915] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:13.509052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b910ba-0100-4035-9436-c6d69462c250 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.509498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b910ba-0100-4035-9436-c6d69462c250 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.509675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b910ba-0100-4035-9436-c6d69462c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.530296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-32b910ba-0100-4035-9436-c6d69462c250 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:13.531809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-32b910ba-0100-4035-9436-c6d69462c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:13.591663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 461/916] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:13 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:13.617979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5e33-5288-4848-af11-d7aed65f61b0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:13.630635 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5e33-5288-4848-af11-d7aed65f61b0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:13.637177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd0817-2151-4ad6-93d2-fabeafc1a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:13.637967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd0817-2151-4ad6-93d2-fabeafc1a831 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:13.638386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd0817-2151-4ad6-93d2-fabeafc1a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:13.638776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd0817-2151-4ad6-93d2-fabeafc1a831 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:13.639622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd0817-2151-4ad6-93d2-fabeafc1a831 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:13.641373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd0817-2151-4ad6-93d2-fabeafc1a831 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:13.718398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 456/917] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:13 2022] POST /identity/v3/services => generated 241 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:14.224387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0fc6-aaa9-4b3b-8380-4d075272328d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:14.224977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0fc6-aaa9-4b3b-8380-4d075272328d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:14.225463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba0fc6-aaa9-4b3b-8380-4d075272328d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:14.227757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 462/918] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:14.233312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:14.233865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:14.234411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:14.253366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:14.254952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:14.272217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 457/919] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:14 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:14.297081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba0fc6-aaa9-4b3b-8380-4d075272328d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:14.310379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba0fc6-aaa9-4b3b-8380-4d075272328d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:14.315068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:14.316097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:14.316581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:14.317078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:14.317963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:14.320562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:14.332354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 11:17:14.334093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 463/920] 10.222.0.20 () {56 vars in 1153 bytes} [Mon Jan 10 11:17:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:14.340989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:14.351498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8289-8efc-45b7-b2df-de1e0d8a1bd9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:14.356601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:14.357538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:14.358056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:14.358574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:14.359507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:14.360029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:14.361855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:14.368403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 458/921] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:14.374583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:14.385646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de6f8e-6ba5-4c12-8d89-3089f7261bce admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:14.393177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:14.394156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:14.394679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:14.395222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:14.396336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:14.397401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:14.399781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019222ea-d335-4a04-a4fd-b18023f17dca admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:14.406779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 464/922] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:14.414040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:14.425581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3329-fc83-4c73-9b11-ce71f6cc95ac admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:14.431792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c51d-71ef-4941-ac11-d224583f5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:14.432805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c51d-71ef-4941-ac11-d224583f5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:14.433295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c51d-71ef-4941-ac11-d224583f5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:14.433843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c51d-71ef-4941-ac11-d224583f5c7e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:14.434845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938c51d-71ef-4941-ac11-d224583f5c7e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:14.436740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938c51d-71ef-4941-ac11-d224583f5c7e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:14.520259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 459/923] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:15.255326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0320f-4cfb-4da9-876c-44b23392eba6 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.257275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0320f-4cfb-4da9-876c-44b23392eba6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.257942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0320f-4cfb-4da9-876c-44b23392eba6 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.260299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 465/924] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:15.265678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.265969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.266270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.284781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:15.285970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:15.305090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 460/925] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:15 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:15.330446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0320f-4cfb-4da9-876c-44b23392eba6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.344266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0320f-4cfb-4da9-876c-44b23392eba6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.349403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.350932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.351427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.351929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.352816 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.354735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:15.366876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 11:17:15.368752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 466/926] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:15.374609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.384179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117479af-590c-4a07-b097-ebdc724b93e8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.388804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.389528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.389815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.390090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.390858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:15.391163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.392788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:15.398955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 461/927] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:15.404652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.415871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e43c0-d0ae-4bfb-b0e6-d59526a583c3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.420639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.421287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.421566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.421836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.422591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:15.422898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.424493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:15.430632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 467/928] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:15.436439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.447439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fd7f9-838d-4e7b-9491-3d911d1735ff admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.452114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.452764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.453046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.453498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.457937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] RBAC: Adding query filter params (interface=public, service_id=19eefaf2e28b4ad0bd807d136fb656ae, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:15.457937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.457937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6dcf2-2619-4bc7-9190-1dd42640a14d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:15.470716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 462/929] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/endpoints?service_id=19eefaf2e28b4ad0bd807d136fb656ae&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:15.471505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.483890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c4b50-067f-41c1-b6d0-17f29fd2d820 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.490252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891a6a1-3dfc-4c74-a9a8-931357756551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.490252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a6a1-3dfc-4c74-a9a8-931357756551 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.490252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a6a1-3dfc-4c74-a9a8-931357756551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.490252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891a6a1-3dfc-4c74-a9a8-931357756551 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.490653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891a6a1-3dfc-4c74-a9a8-931357756551 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.490894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891a6a1-3dfc-4c74-a9a8-931357756551 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:15.498647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 468/930] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:17:15.797707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ad2b-65f5-4b4a-8722-36fe53762a48 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.798252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ad2b-65f5-4b4a-8722-36fe53762a48 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.798252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ad2b-65f5-4b4a-8722-36fe53762a48 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.800223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 463/931] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:15.807196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.807500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.807775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.828267 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:15.829533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:15.838600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 469/932] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:15 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:15.864927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ad2b-65f5-4b4a-8722-36fe53762a48 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.879160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ad2b-65f5-4b4a-8722-36fe53762a48 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.885038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.885843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.886125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.886435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.898456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:15.906022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 11:17:15.907573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 464/933] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:15.914777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.924071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31329b91-022a-479d-bc82-a0420abbdf2a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.930173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.930923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.931261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.931543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.932317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:15.932625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.934312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:15.943887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 470/934] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:15.950096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:15.962887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2624-89c5-4f42-aec5-a8b4c7a1f97f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:15.967644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:15.968482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:15.968766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:15.969044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:15.981612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:15.983574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.003216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:16.004720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 465/935] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:16.011591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.021584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bac8b-2d9e-4fc6-81cc-b3ec141c4140 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.027612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.028327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.028612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.028937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.029781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.030091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.031785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.045089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 471/936] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:16.050788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.061601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401646da-ee08-41d9-b520-f997ce0db645 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.066396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.067245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.067585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.067864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.077174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.079239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.095851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 11:17:16.097385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 466/937] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:16.103687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.113741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67712ab2-f009-425c-995e-a028898e25f8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.118463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.119127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.119407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.119680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.120530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.120833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.122729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.142556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 472/938] 10.222.0.20 () {56 vars in 1170 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:16.149221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.159436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8660cf-d10c-43d5-8412-94d2825599de admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.164639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.165285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.165617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.165899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.174718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.176549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.187055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 467/939] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:16.192715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.209922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9aef0-1695-4850-9d93-3dd2cf9b5982 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.214900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.215741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.216069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.216345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.227344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.229192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.247061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:16.248844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 473/940] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:16.254413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.264962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf05ba-153c-4862-a94b-098fd06a7a16 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.269709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.270441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.270726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.271004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.272914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.273230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.274932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189889f5-100c-4906-ab3f-58e5cc38ed22 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.288186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 468/941] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:16.293811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.305152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bcf3-461d-4c41-8575-2f736eaf7d12 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.309937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.310815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.311097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.311371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.314658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940f389-7397-40cd-b7eb-d66b04620893 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.314941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940f389-7397-40cd-b7eb-d66b04620893 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.315214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940f389-7397-40cd-b7eb-d66b04620893 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.317272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 469/942] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:16.321292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.323559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.324297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.324591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.324875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.337848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:16.339424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 474/943] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:16.345380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.346457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:16.347760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:16.362364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 470/944] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:16 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:16.362542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df71f3b-ec22-44ae-9873-4d4971b7aa62 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.367551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.368417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.368838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.369250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.370265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.370789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.373168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.385772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.388732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 475/945] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:16.394796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.395384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954db372-8835-4c71-b38f-6fbe0411c7a8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.400552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.401655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.401939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.402243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.403535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.405587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.407374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6684b-bfbf-4bca-a277-9130febd8434 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.412882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119282d-b774-4928-8786-450650d36afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.413968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119282d-b774-4928-8786-450650d36afe admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.414493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119282d-b774-4928-8786-450650d36afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.415026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119282d-b774-4928-8786-450650d36afe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.416070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119282d-b774-4928-8786-450650d36afe admin admin] RBAC: Adding query filter params (role.id=7446d3c1ada747cbaea2c5a13209f7d1, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.416584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119282d-b774-4928-8786-450650d36afe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.418714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119282d-b774-4928-8786-450650d36afe admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.419791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 11:17:16.425731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 471/946] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:16.427179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.427360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 476/947] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/role_assignments?user.id=b4b5d6a7bf664a98bb17f6fcbbca69bd&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=7446d3c1ada747cbaea2c5a13209f7d1 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:16.444493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb75ce3-ad3f-4ed8-a09b-cbf3ab99c332 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.449409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.450128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.450450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.450727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.451535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.451837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.453585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.460806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 472/948] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:16.466552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119282d-b774-4928-8786-450650d36afe admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.478042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119282d-b774-4928-8786-450650d36afe admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.491160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.491830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.492109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.492381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.493114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.493469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.495250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.508556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 477/949] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:16.514636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.525792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd370d7-cb08-4cff-9907-5d7d75511ca3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.531099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.532174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.532663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.533615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.534812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] RBAC: Adding query filter params (interface=public, service_id=ebca2816367c4d259232e77bc110cc9a, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:16.535351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.537936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7444152-e607-4c48-9e66-c67f1f6d1514 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.544962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 473/950] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/endpoints?service_id=ebca2816367c4d259232e77bc110cc9a&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:16.551027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:16.561891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbc1ee-6b8e-45f3-aa49-34cfffa2a636 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:16.567023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83251a5f-825a-4f5b-abd3-7c4a93fc83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:16.567996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251a5f-825a-4f5b-abd3-7c4a93fc83ab admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:16.568506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251a5f-825a-4f5b-abd3-7c4a93fc83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:16.568981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83251a5f-825a-4f5b-abd3-7c4a93fc83ab admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:16.569880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83251a5f-825a-4f5b-abd3-7c4a93fc83ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:16.572071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83251a5f-825a-4f5b-abd3-7c4a93fc83ab admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:16.580009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 478/951] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:16 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:17:17.159197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5332c5-27c8-49f9-ae07-99958a71eda8 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:17.159720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5332c5-27c8-49f9-ae07-99958a71eda8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:17.159720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5332c5-27c8-49f9-ae07-99958a71eda8 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:17.161784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 474/952] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:17.170509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:17.170891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:17.171025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:17.189799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:17.191002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:17.202380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 479/953] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:17 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:17.223084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5332c5-27c8-49f9-ae07-99958a71eda8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:17.236039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5332c5-27c8-49f9-ae07-99958a71eda8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:17.240434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:17.241212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:17.241486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:17.241751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:17.242453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:17.244029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:17.255431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 11:17:17.261692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 475/954] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:17.263047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:17.272728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b76d5-f80d-4195-a627-d1cda35aed14 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:17.277124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:17.277782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:17.278066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:17.278362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:17.279078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:17.279377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:17.280968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc39bf-95d1-44a2-b77a-3f73f7b9230c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:17.290324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 480/955] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:17.292570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:17.302292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff05ab5-e872-45e1-b294-1e4f2d6caa9d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:17.307885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:17.309004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:17.309508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:17.309986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:17.310978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:17.311286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:17.313651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2eb9-4030-436c-8b0c-2e2bbee172b2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:17.326407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 476/956] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:18.063217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dca9d-a233-4845-9ba5-3d0989f44d96 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.063919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dca9d-a233-4845-9ba5-3d0989f44d96 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.063919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dca9d-a233-4845-9ba5-3d0989f44d96 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:18.065771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 481/957] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:18.071190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.071473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.071748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:18.090146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:18.091369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:18.100133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 477/958] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:18 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:18.125198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dca9d-a233-4845-9ba5-3d0989f44d96 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:18.138148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dca9d-a233-4845-9ba5-3d0989f44d96 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:18.142524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:18.143312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.143592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.143865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:18.144529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:18.146199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:18.157821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 11:17:18.159355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 482/959] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:18.165770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:18.174767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b0b99-7d0d-45d2-91c8-5309e15821b1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:18.179552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:18.180286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.180571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.180848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:18.181582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:18.181886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:18.183538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:18.189156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 478/960] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:18.195474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:18.205356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ead446-618c-4930-a0ad-e266a60a3785 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:18.210299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:18.210956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.211240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.211514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:18.212241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:18.212541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:18.214139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4608a-c0cc-4ef2-a3d9-b8a481f4f9bd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:18.219783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 483/961] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Jan 10 11:17:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:18.225935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:18.235573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dbfc8-a5c1-4cdc-8e4e-fd9eb442a47e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:18.240119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a95ce5-c042-45a1-9f10-30442e929086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:18.240766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a95ce5-c042-45a1-9f10-30442e929086 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.241052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a95ce5-c042-45a1-9f10-30442e929086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.241328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a95ce5-c042-45a1-9f10-30442e929086 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:18.242074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a95ce5-c042-45a1-9f10-30442e929086 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:18.243693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a95ce5-c042-45a1-9f10-30442e929086 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:18.325484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 479/962] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:18.997655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb889c0-0ff1-4501-ace8-697d132fe387 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:18.998071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb889c0-0ff1-4501-ace8-697d132fe387 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:18.998267 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb889c0-0ff1-4501-ace8-697d132fe387 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.000240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 484/963] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:19.007619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.007903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.008179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.026452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:19.027639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:19.044981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 480/964] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:19 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:19.067062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb889c0-0ff1-4501-ace8-697d132fe387 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.080286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb889c0-0ff1-4501-ace8-697d132fe387 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.085441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.086243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.086531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.086810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] PATH_INFO: `/v3/services/image` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.087477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.089073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.100636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 11:17:19.102128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 485/965] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jan 10 11:17:19 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:19.108245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.117421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175663e-49dc-48f2-bcc1-53fce907b575 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.122444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.123108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.123393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.123669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.124398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:19.124700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.126329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746afb06-287f-4c10-8e54-575c6f2292b0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.132002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 481/966] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:19.137624 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.150461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e833f-b4e5-4972-9033-573bc1ae35e3 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.150461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e833f-b4e5-4972-9033-573bc1ae35e3 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.150461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e833f-b4e5-4972-9033-573bc1ae35e3 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.151036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ba547-4012-4563-8df4-bf5f5e803ceb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.151188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 482/967] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:19.153445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.154099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.154427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.154703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.155431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:19.155738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.158669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.158882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.158882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.158882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.163215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 486/968] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:19.179060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:19.181078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:19.189924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 483/969] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:19 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:19.216398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.227858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dd8af-7189-4aa2-912d-4da1d1e91d02 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.233182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.234462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.234978 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.235453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.236346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.238252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.251063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 11:17:19.252991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 487/970] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:19.260030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.269740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62639a8c-4d7f-4382-a6aa-a995652a8e5a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.275851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.276871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.277428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.277905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.278968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:19.279489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.281428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.287954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 484/971] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:19.294159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.306326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d967-4e6b-4665-a92d-52a697095ad1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.311945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.313023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.313553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.314112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.315110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:19.315625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.318694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e5d76-c81a-4756-93b9-5e2d6557b58a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.329849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 488/972] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:19.336220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.347808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817925-4fd8-42ff-bd19-cd4b73f3ef5d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.358655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f95b75-3c36-45d2-a157-f56ba0bb9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.359825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f95b75-3c36-45d2-a157-f56ba0bb9cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.360421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f95b75-3c36-45d2-a157-f56ba0bb9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.360917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f95b75-3c36-45d2-a157-f56ba0bb9cd0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.362018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f95b75-3c36-45d2-a157-f56ba0bb9cd0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.364693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f95b75-3c36-45d2-a157-f56ba0bb9cd0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.467440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 485/973] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:19.817128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c62-3ac3-4b1e-9978-e42370ab5a37 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.817426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c62-3ac3-4b1e-9978-e42370ab5a37 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.817592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c62-3ac3-4b1e-9978-e42370ab5a37 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.819767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 489/974] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:19.825237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b875-e305-430a-be4b-d28505a9e2c8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.825528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b875-e305-430a-be4b-d28505a9e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.825806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110b875-e305-430a-be4b-d28505a9e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.843769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-7110b875-e305-430a-be4b-d28505a9e2c8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:19.844940 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7110b875-e305-430a-be4b-d28505a9e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:19.870646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 486/975] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:19 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:19.897142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4c62-3ac3-4b1e-9978-e42370ab5a37 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:19.909682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4c62-3ac3-4b1e-9978-e42370ab5a37 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:19.914148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f46b3-4135-4811-91ff-040c5057564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:19.914830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f46b3-4135-4811-91ff-040c5057564b admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:19.915103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f46b3-4135-4811-91ff-040c5057564b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:19.915370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f46b3-4135-4811-91ff-040c5057564b admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:19.916099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f46b3-4135-4811-91ff-040c5057564b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:19.917704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f46b3-4135-4811-91ff-040c5057564b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:19.990477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 490/976] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:19 2022] POST /identity/v3/services => generated 242 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:17:20.927866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31331c-5fa6-4884-9e7a-ea0341225dbd None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:20.928362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31331c-5fa6-4884-9e7a-ea0341225dbd None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:20.928362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31331c-5fa6-4884-9e7a-ea0341225dbd None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:20.930385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 487/977] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:20.935919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:20.936534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:20.936534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:20.955038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:20.956242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:20.973885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 491/978] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:20 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:20.999533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31331c-5fa6-4884-9e7a-ea0341225dbd None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:21.012698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31331c-5fa6-4884-9e7a-ea0341225dbd None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:21.017113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:21.017766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:21.018046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:21.018347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:21.019077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:21.021202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:21.022602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.common [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 10 11:17:21.070413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.sql.core [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 10 11:17:21.070413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 10 11:17:21.070413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [parameters: {'id': '6dba778291c741b58b108802bd15f9ab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 10 11:17:21.070413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 11:17:21.077094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6dba778291c741b58b108802bd15f9ab.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6dba778291c741b58b108802bd15f9ab. Jan 10 11:17:21.078749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 488/979] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Jan 10 11:17:20 2022] POST /identity/v3/projects => generated 262 bytes in 80 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:21.084899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:21.094287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01019dd5-7a7c-4be5-8729-474c12798ab9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:21.099212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:21.100059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:21.100335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:21.101344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:21.108078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:21.110003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:21.124307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b239242e-aa95-4071-9b12-089a146bea5b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:21.125870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 492/980] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:21.132803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:21.143981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b67fba-a4d8-4aeb-8d70-00e5116ff807 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:21.148944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:21.149725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:21.150013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:21.150309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:21.151155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:21.151464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:21.153700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4004f4-7eea-46bf-982a-2a49cdb6e3df admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:21.178087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 489/981] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:21.685197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568badb-6162-40e6-bd41-1528f73f8b73 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:21.685570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568badb-6162-40e6-bd41-1528f73f8b73 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:21.685759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568badb-6162-40e6-bd41-1528f73f8b73 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:21.687812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 493/982] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:21.694481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec019f50-dc24-4949-9cb5-da4522ca6ada None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:21.695077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec019f50-dc24-4949-9cb5-da4522ca6ada None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:21.695560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec019f50-dc24-4949-9cb5-da4522ca6ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:21.715013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ec019f50-dc24-4949-9cb5-da4522ca6ada None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:21.716860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ec019f50-dc24-4949-9cb5-da4522ca6ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:21.725807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 490/983] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:21 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:21.752689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568badb-6162-40e6-bd41-1528f73f8b73 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:21.766773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568badb-6162-40e6-bd41-1528f73f8b73 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:21.777066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffd883-28a2-4d25-b69f-f7a1293ec03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:21.778037 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffd883-28a2-4d25-b69f-f7a1293ec03d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:21.778554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffd883-28a2-4d25-b69f-f7a1293ec03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:21.779238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffd883-28a2-4d25-b69f-f7a1293ec03d admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:21.780202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffd883-28a2-4d25-b69f-f7a1293ec03d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:21.782013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffd883-28a2-4d25-b69f-f7a1293ec03d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:21.895832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 494/984] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:21 2022] POST /identity/v3/services => generated 242 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:22.043151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fbfd-bd4f-4642-88ac-4ec2ec8d9732 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.043686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fbfd-bd4f-4642-88ac-4ec2ec8d9732 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.043686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31fbfd-bd4f-4642-88ac-4ec2ec8d9732 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.045883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 491/985] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:22.052529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.053080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.053080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.073328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:22.074943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:22.094327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 495/986] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:22 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:22.120633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fbfd-bd4f-4642-88ac-4ec2ec8d9732 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.133906 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31fbfd-bd4f-4642-88ac-4ec2ec8d9732 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.138573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.139389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.139670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.139944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.140624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.142314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.155196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 11:17:22.156310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 492/987] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:22.163056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.172200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aae60-7336-46dc-a65b-b8dd903de10d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.177514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.178178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.178544 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.178826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.179585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:22.179941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.181607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.187356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 496/988] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:22.193153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.204057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f794a5-0562-403d-bf5f-a14554aea980 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.210475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.211463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.211924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.212415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.213432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:22.213944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.215836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.222192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 493/989] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:22.229056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.240181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59947-244f-477d-bdb9-8482c5141d4f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.245243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.246425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.246872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.247325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.248356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] RBAC: Adding query filter params (interface=admin, service_id=ebca2816367c4d259232e77bc110cc9a, region_id=RegionOne) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:22.248859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.250730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607028c-fd9d-452d-b7b0-2de09e96144a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.257760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 497/990] 10.222.0.20 () {56 vars in 1270 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/endpoints?service_id=ebca2816367c4d259232e77bc110cc9a&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:22.264222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.277042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370e4e-b9c6-466f-9241-b1561a0e8cc1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.283443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0be9-04bb-48df-8453-868509e3801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.286583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0be9-04bb-48df-8453-868509e3801f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.287091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0be9-04bb-48df-8453-868509e3801f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.287921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0be9-04bb-48df-8453-868509e3801f admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.289541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d0be9-04bb-48df-8453-868509e3801f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.291750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d0be9-04bb-48df-8453-868509e3801f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.301659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 494/991] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services => generated 1957 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:17:22.518500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b0e1d-8312-4a00-9914-b609741c97f2 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.518801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b0e1d-8312-4a00-9914-b609741c97f2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.519051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b0e1d-8312-4a00-9914-b609741c97f2 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.521835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 498/992] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:22.527580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.527865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.528140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.548396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:22.549574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:22.557589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 495/993] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:22 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:22.582572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b0e1d-8312-4a00-9914-b609741c97f2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.594976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b0e1d-8312-4a00-9914-b609741c97f2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.600219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.601006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.601278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.601541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.602202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.603831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.615415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 11:17:22.621844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 499/994] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:22.623251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.633491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4152b-2ca7-49fe-815c-dd432dc0bd4e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.643785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.643785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.643785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.643785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.644187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:22.644187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.645216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.657160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 496/995] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:22.660735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.670799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a75ab-19b3-4b72-8db2-512d09913386 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.675560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.676223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.676556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.676823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.677535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:22.677881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.679567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.689704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 500/996] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:22.691094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.702065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e9b15-4fd5-41d8-9cac-662beeab70c9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.707992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.708878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.709222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.709563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.710535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] RBAC: Adding query filter params (interface=public, service_id=72e62ec0c40243c7b8779ab33bee430c, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:22.710908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.712615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17966-8650-4119-b8a2-c14b5684a408 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.722345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 497/997] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/endpoints?service_id=72e62ec0c40243c7b8779ab33bee430c&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:22.725225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:22.736023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9283a9-1b78-4b59-a0f4-7937352199d1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:22.741347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d357a4-d9e1-4d63-8641-5a174a967a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:22.742333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d357a4-d9e1-4d63-8641-5a174a967a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:22.742833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d357a4-d9e1-4d63-8641-5a174a967a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:22.743361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d357a4-d9e1-4d63-8641-5a174a967a13 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:22.744240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d357a4-d9e1-4d63-8641-5a174a967a13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:22.746419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d357a4-d9e1-4d63-8641-5a174a967a13 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:22.758384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 501/998] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:22 2022] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:17:23.793230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca908d-2946-4b44-9175-e06ae5a9bf43 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:23.793914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca908d-2946-4b44-9175-e06ae5a9bf43 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:23.793914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca908d-2946-4b44-9175-e06ae5a9bf43 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:23.795787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 498/999] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:23.802340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:23.803009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:23.803009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:23.823148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:23.824501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:23.833036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 502/1000] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:23 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:23.859883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca908d-2946-4b44-9175-e06ae5a9bf43 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:23.873107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca908d-2946-4b44-9175-e06ae5a9bf43 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:23.877526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:23.878180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:23.879222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:23.879503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:23.880324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:23.882166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:23.921291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.sql.core [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 10 11:17:23.921291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 10 11:17:23.921291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [parameters: {'user_id': '5c3c6ac0248043d1beca61156f57a435', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 10 11:17:23.921291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 11:17:23.927890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 10 11:17:23.929493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 499/1001] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:17:23 2022] POST /identity/v3/users => generated 160 bytes in 70 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:23.935672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:23.946614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee973-2860-4a78-ba3a-8fd1ae4623e9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:23.951567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:23.952391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:23.952669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:23.952943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:23.961206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:23.963342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:23.977525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-c5816003-95b5-4489-aa0c-50fbc82d276c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 11:17:23.979115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 503/1002] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:23.985052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:23.997091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d9db2-40e7-4255-8f04-339590c7abf3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.001907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.002685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.002964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.003273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.004662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:24.004967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.007305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c18c7d-8bf3-4d2e-baa8-67e2e208c163 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.053040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 500/1003] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Jan 10 11:17:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:24.600430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a618cff-f31d-47cd-8427-37011b211560 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.600716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a618cff-f31d-47cd-8427-37011b211560 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.601181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a618cff-f31d-47cd-8427-37011b211560 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.603016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 504/1004] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:24.608655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.609159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.609444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.630977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:24.632548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:24.640631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 501/1005] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:24 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:24.667246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a618cff-f31d-47cd-8427-37011b211560 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.680186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a618cff-f31d-47cd-8427-37011b211560 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.684504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.685281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.685564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.685837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.686530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.688133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.699811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 11:17:24.701157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 505/1006] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:24.707941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.717123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9203-845f-49dd-a8a3-2c3192947353 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.721617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.723532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.723821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.724097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.724827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:24.725134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.726927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.732563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 502/1007] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:24.738292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.748379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344af3e-31b1-4a95-af31-d12c2ad5eb7b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.752988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.753643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.753923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.754196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.754990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:24.755242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.756835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.762116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 506/1008] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:24.767774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.779079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e184c-2e5e-49e2-bf6a-f41842b568f3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.785051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.785863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.786143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.786453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.787300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] RBAC: Adding query filter params (interface=public, service_id=214ff54e76b64dee84de5858974d5c99, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:24.787616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.789382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908e48-d568-47f8-b36f-ad3255982ec5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.800126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 503/1009] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/endpoints?service_id=214ff54e76b64dee84de5858974d5c99&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:24.801981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.812537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a8342-978d-4df8-aff3-63b2e5cae151 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.817360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49b880-39ce-440a-9cb3-83f8e0f5f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.818090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b880-39ce-440a-9cb3-83f8e0f5f769 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.818406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b880-39ce-440a-9cb3-83f8e0f5f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.818680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49b880-39ce-440a-9cb3-83f8e0f5f769 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.821403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49b880-39ce-440a-9cb3-83f8e0f5f769 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.821403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49b880-39ce-440a-9cb3-83f8e0f5f769 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.828322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 507/1010] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:17:24.843666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d3799-76be-4592-9cf0-a6ca4d6c856b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.844007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d3799-76be-4592-9cf0-a6ca4d6c856b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.844305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d3799-76be-4592-9cf0-a6ca4d6c856b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.846324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 504/1011] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:24.852620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.852867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.853149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.876603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:24.877840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:24.886687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 508/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:24 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:24.912988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d3799-76be-4592-9cf0-a6ca4d6c856b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.926171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d3799-76be-4592-9cf0-a6ca4d6c856b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.930937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.931751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.932031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.932303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.932977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.934633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.947247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 11:17:24.948497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 505/1013] 10.222.0.20 () {56 vars in 1147 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:24.954550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.964605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbab257-afde-4fa9-a3c9-d38bf561df4a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:24.969257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:24.970100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:24.970483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:24.970828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:24.971639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:24.972261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:24.974020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:24.979944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 509/1014] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:24.985619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:24.996146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4fcc-305b-47f4-88c8-055b80e9cf75 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:25.000753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:25.001418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.001699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.001970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.002744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:25.003954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:25.005714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418f0b-7b07-4d23-8e4c-f4a84950d39c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:25.011987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 506/1015] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Jan 10 11:17:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:25.017943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:25.029001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8afb0-3c9a-4b45-88e7-39cd39ee8378 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:25.037061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc6ea5-118e-44f1-a490-834fa02efd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:25.037781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6ea5-118e-44f1-a490-834fa02efd8c admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.038059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6ea5-118e-44f1-a490-834fa02efd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.038370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6ea5-118e-44f1-a490-834fa02efd8c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.039195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc6ea5-118e-44f1-a490-834fa02efd8c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:25.040879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc6ea5-118e-44f1-a490-834fa02efd8c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:25.109827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 510/1016] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:25.253533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373df0d-8a05-4ec2-948a-18c12284a240 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.253913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373df0d-8a05-4ec2-948a-18c12284a240 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.254082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373df0d-8a05-4ec2-948a-18c12284a240 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.256132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 507/1017] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:25.261997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.262328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.262580 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.291318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:25.292567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:25.311784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 511/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:25 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:25.337036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373df0d-8a05-4ec2-948a-18c12284a240 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:25.349562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373df0d-8a05-4ec2-948a-18c12284a240 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:25.354295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:25.355402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.355686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.355960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.356632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:25.358259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:25.371328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 11:17:25.372781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 508/1019] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:25.379463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:25.388708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030687b0-9bb6-4cd8-b69a-c3f09e918849 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:25.393635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:25.394677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.394957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.395282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.396138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:25.396443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:25.398081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:25.404319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 512/1020] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:25.411043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:25.421795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75972-a51c-4073-a3d2-f9ad92981ba0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:25.427786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:25.428451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.428788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.429066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.429835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:25.430150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:25.431871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802199f-b4c5-4b97-8f4b-0bb000518cb7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:25.437592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 509/1021] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Jan 10 11:17:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:25.444316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:25.454242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1dbca-a376-4020-9977-d1efcede29ce admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:25.459165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d7e26-7be4-40a8-ba5b-bd1dd5c3fbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:25.459883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7e26-7be4-40a8-ba5b-bd1dd5c3fbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:25.460226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7e26-7be4-40a8-ba5b-bd1dd5c3fbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:25.460584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7e26-7be4-40a8-ba5b-bd1dd5c3fbc0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:25.461427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d7e26-7be4-40a8-ba5b-bd1dd5c3fbc0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:25.463096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d7e26-7be4-40a8-ba5b-bd1dd5c3fbc0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:25.544687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 513/1022] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:17:27.326733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9b51-a491-4245-a1d8-412e10c5abdc None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.327302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9b51-a491-4245-a1d8-412e10c5abdc None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.327302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9b51-a491-4245-a1d8-412e10c5abdc None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.329039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 510/1023] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:27.334625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.335027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.335210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.353505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:27.354709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:27.372610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 514/1024] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:27 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:27.397508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9b51-a491-4245-a1d8-412e10c5abdc None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:27.421910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9b51-a491-4245-a1d8-412e10c5abdc None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:27.427719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:27.428497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.428773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.429041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.429702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:27.431313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:27.443592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 11:17:27.445002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 511/1025] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Jan 10 11:17:27 2022] GET /identity/v3/services/image => generated 86 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:27.450948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:27.460402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204ec68-884a-4e7f-aba8-6398f79f4261 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:27.464991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:27.465731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.466081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.466465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.467261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:27.467635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:27.469332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:27.478250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 515/1026] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:27.481795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:27.495389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c24d8-b625-4c93-a5e0-9c5822731ef0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:27.499958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:27.503420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.503420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.503420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.503420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:27.503420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:27.505360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385c363-ac03-45e7-8d62-cabdefe9d4c6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:27.519029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 512/1027] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:27.524507 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:27.535149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6b867-d32e-4d5f-8e70-e2db1d7f65f8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:27.539632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:27.540282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.540562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.540835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.541594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:27.543212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:27.618025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcb319-2436-4e24-ab04-fd1379ed8d76 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.618361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcb319-2436-4e24-ab04-fd1379ed8d76 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.618649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcb319-2436-4e24-ab04-fd1379ed8d76 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.620693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 513/1028] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:17:27.625481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.625765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.626041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.644618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:27.645708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 516/1029] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:17:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:27.645835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:27.667388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 514/1030] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:27.693493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:27.704467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8f3b8-bb10-4c98-9098-6922006b0ed1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:27.709744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af583b-5fc0-49bb-a76f-c2634ab934aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:27.710600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af583b-5fc0-49bb-a76f-c2634ab934aa admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.710877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af583b-5fc0-49bb-a76f-c2634ab934aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.711146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af583b-5fc0-49bb-a76f-c2634ab934aa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.712433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af583b-5fc0-49bb-a76f-c2634ab934aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:27.714278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af583b-5fc0-49bb-a76f-c2634ab934aa admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:27.716191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 517/1031] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:27.722747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:27.731946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b8be-ce5b-4bf6-88bc-00afc327818b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:27.736827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1884a-5eef-44e8-9009-920b4f4266c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:27.737513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1884a-5eef-44e8-9009-920b4f4266c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:27.737789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1884a-5eef-44e8-9009-920b4f4266c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:27.738062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1884a-5eef-44e8-9009-920b4f4266c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:27.738828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1884a-5eef-44e8-9009-920b4f4266c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:27.740777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1884a-5eef-44e8-9009-920b4f4266c1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:27.854417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 515/1032] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:27 2022] POST /identity/v3/projects => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:28.142328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da27df3-b764-4929-8276-5d70915a516a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.143639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da27df3-b764-4929-8276-5d70915a516a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.144173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da27df3-b764-4929-8276-5d70915a516a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.146311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 518/1033] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:28.151433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.151803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.152135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.170520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:28.171723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:28.229931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 516/1034] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:28.256636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da27df3-b764-4929-8276-5d70915a516a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.269348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da27df3-b764-4929-8276-5d70915a516a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.273643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.274472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.274750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.275020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.286029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:28.293332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 11:17:28.294760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 519/1035] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:28.301058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.309820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697114c8-c9d9-475a-9588-c7c91f745cec None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.314330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.315732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.316013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.316286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.317043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:28.317343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.318978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.327461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 517/1036] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:28.333014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.346443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3100-5a4c-4cd3-88f0-8dedf15572b6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.351644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.352405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.352773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.353110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.365115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.366983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.386921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:28.388351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 520/1037] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:28.394373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.404413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604159-f8e8-4971-a6c1-0f4c4a2e6395 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.409104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.409750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.410028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.410327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.411154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:28.411433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.413021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.430235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 518/1038] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:28.431889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.442318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8afae1-db53-443e-898a-93850dc1c295 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.446868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.447634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.447914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.448194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.456348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.458416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.472933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:17:28.474347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 521/1039] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:28.479831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.489934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dacdee-1d4d-446a-839e-4a342dc926db admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.494866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.495622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.495978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.496327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.497258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:28.497630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.499596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.524746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 519/1040] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:28.526087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.536801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b0f3c-710c-42ac-9af2-a28af7ff04b9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.541406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.542119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.542506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.542791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.551269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.553061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.562271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 522/1041] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:28.568001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.577957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff7ece-7e8b-43ce-bc29-84dbdf0a8936 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.583181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.584041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.584391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.584733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.597172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.599093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.616050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:28.617397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 520/1042] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:28.623179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.632976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d43912-2b33-467c-8218-2f9b79ca269c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.637587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.638332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.638679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.639017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.639812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:28.640263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.641962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.658505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 523/1043] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:28.660663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.670325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9542b7-3e10-4e66-9fa8-0c297776bd94 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.674814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.675586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.675862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.676130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.683110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.685073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.698544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:28.699889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 521/1044] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:28.707545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.717398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397590c-7eb1-48f3-a4fc-dbf175e6f40c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.722142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.722894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.723244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.723603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.724461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:28.724832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.726805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec4ef-42fd-4f27-bc4a-32b8bf27e0fe admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.740016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 524/1045] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:28.746786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:28.759545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ad984-74ba-4377-84a6-dd44005febf0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:28.764268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:28.764939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:28.765222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:28.765497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:28.766393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] RBAC: Adding query filter params (role.id=7446d3c1ada747cbaea2c5a13209f7d1, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=df05886e51f34628a524477b98227f40) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:28.766705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:28.769262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34eaccc-55dd-4e85-b56f-3bb9ebc62e72 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:28.775666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 522/1046] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:28 2022] GET /identity/v3/role_assignments?user.id=df05886e51f34628a524477b98227f40&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=7446d3c1ada747cbaea2c5a13209f7d1 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:30.214918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4c93-0b67-4b57-bd39-6bf9a65869c9 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.215442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4c93-0b67-4b57-bd39-6bf9a65869c9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.215442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4c93-0b67-4b57-bd39-6bf9a65869c9 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.217510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 525/1047] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:30.225064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.225543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.225622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.243838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:30.245060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:30.253581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 523/1048] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:30.277073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4c93-0b67-4b57-bd39-6bf9a65869c9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:30.290113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4c93-0b67-4b57-bd39-6bf9a65869c9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:30.294682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f1349-a739-48d8-83ac-7363efa3e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:30.295319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1349-a739-48d8-83ac-7363efa3e12b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.295601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1349-a739-48d8-83ac-7363efa3e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.295875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1349-a739-48d8-83ac-7363efa3e12b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.304849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f1349-a739-48d8-83ac-7363efa3e12b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:30.306659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f1349-a739-48d8-83ac-7363efa3e12b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:30.317585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 526/1049] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:30.323330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:30.333725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eee0e-ccd6-480e-ae07-05fb1f3928e7 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:30.338181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01898f5-8fa1-43c3-a489-d6aa0053f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:30.339000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01898f5-8fa1-43c3-a489-d6aa0053f260 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.339284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01898f5-8fa1-43c3-a489-d6aa0053f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.339563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01898f5-8fa1-43c3-a489-d6aa0053f260 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.340741 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01898f5-8fa1-43c3-a489-d6aa0053f260 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:30.342460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01898f5-8fa1-43c3-a489-d6aa0053f260 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:30.344233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 524/1050] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:30.479251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a1a27-14cb-48e0-a817-0e43d6e7408d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.479457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a1a27-14cb-48e0-a817-0e43d6e7408d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.479845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a1a27-14cb-48e0-a817-0e43d6e7408d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.482079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 527/1051] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:30.488375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.488705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.488933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.508696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:30.509922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:30.526251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 525/1052] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:17:30.548048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a1a27-14cb-48e0-a817-0e43d6e7408d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:30.561723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a1a27-14cb-48e0-a817-0e43d6e7408d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:30.567218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe82a2-68c2-4c1d-bf79-6b237ee56c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:30.568022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe82a2-68c2-4c1d-bf79-6b237ee56c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.568300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe82a2-68c2-4c1d-bf79-6b237ee56c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.568572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe82a2-68c2-4c1d-bf79-6b237ee56c2b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.569790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe82a2-68c2-4c1d-bf79-6b237ee56c2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:30.571550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe82a2-68c2-4c1d-bf79-6b237ee56c2b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:30.573509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 528/1053] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:30.581161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:30.588329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c044d4e-18f0-49fc-9417-ff87bec4f309 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:30.593012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045291-f62e-4103-8100-1239880c8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:30.593669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045291-f62e-4103-8100-1239880c8da2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:30.593952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045291-f62e-4103-8100-1239880c8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:30.594250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045291-f62e-4103-8100-1239880c8da2 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:30.594988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2045291-f62e-4103-8100-1239880c8da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:30.597208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2045291-f62e-4103-8100-1239880c8da2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:30.685831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 526/1054] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:17:30 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:31.314721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81429-c63a-46ff-a75f-ca0ddc7a6741 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.315257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81429-c63a-46ff-a75f-ca0ddc7a6741 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.315257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81429-c63a-46ff-a75f-ca0ddc7a6741 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.316992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 529/1055] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:31.322202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.322663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.322820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.340280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:31.341449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:31.349220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 527/1056] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:31.375038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81429-c63a-46ff-a75f-ca0ddc7a6741 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.387728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81429-c63a-46ff-a75f-ca0ddc7a6741 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.392095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.392926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.393203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.393469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.403552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:31.410901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 11:17:31.412081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 530/1057] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:31.418017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.427924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca64252-add4-443d-ba31-e20815b621bf None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.432756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.433427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.433708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.433979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.434799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:31.435102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.436702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.451475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 528/1058] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:31.452748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.463314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba0ec9-bc2c-4005-91c3-6d8608adca27 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.467929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.468702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.468981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.469249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.479969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.481865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.499529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:31.500888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 531/1059] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:31.507202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.516910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a55a86-5da0-4efa-ae30-0bd75148d8d1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.529049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.529775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.530109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.530494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.531300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:31.531610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.533789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.545729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 529/1060] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:31.551955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.561730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e76fc6-fbd6-4d9b-92c7-d9e9279b0a8e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.567439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.568160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.568446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.568718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.576227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.578272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.592182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:17:31.593345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 532/1061] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:17:31.599297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.609081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf727b0-2daf-4d24-bd97-2e6e68c6ea6c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.614962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.615618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.615899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.616177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.617028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:31.617338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.619487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.637754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 530/1062] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:31.643789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.653538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90097b00-d1aa-4fd1-94be-026281f63689 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.658823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.659594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.659872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.660144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.670336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.672188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.690331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:31.691503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 533/1063] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:31.697146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.707496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd42db8-c017-43bf-8140-f3640d6fab47 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.712060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.712700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.712976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.713245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.713967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:31.714298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.715889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.727883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 531/1064] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:31.733590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.743707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a82fcc-2b4e-438c-a531-f6934b75cdcb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.748300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.749077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.749360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.749631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.756994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.759019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.772484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:31.773689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 534/1065] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:31.779373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.789483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601f84-26d1-4fb1-9c5b-75902c4ff206 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.795804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.795804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.795804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.795804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.796631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:31.796935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.798874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78e5a4-9ffb-4164-9fa6-b2320cb0a1b2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.811994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 532/1066] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:31.818657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:31.829897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915477f9-0678-465d-b32b-ca6de3d2e60b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:31.834415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37509b-aec2-4b06-8873-c1f384d307df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:31.835282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37509b-aec2-4b06-8873-c1f384d307df admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:31.835557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37509b-aec2-4b06-8873-c1f384d307df admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:31.835864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37509b-aec2-4b06-8873-c1f384d307df admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/df05886e51f34628a524477b98227f40/roles/7446d3c1ada747cbaea2c5a13209f7d1` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:31.838031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37509b-aec2-4b06-8873-c1f384d307df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=df05886e51f34628a524477b98227f40, role_id=7446d3c1ada747cbaea2c5a13209f7d1)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:31.840717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37509b-aec2-4b06-8873-c1f384d307df admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:31.912921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 535/1067] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:17:31 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/df05886e51f34628a524477b98227f40/roles/7446d3c1ada747cbaea2c5a13209f7d1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:17:33.215255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879ded-15af-4953-9cb3-3da87c68e112 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.215792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879ded-15af-4953-9cb3-3da87c68e112 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.215792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879ded-15af-4953-9cb3-3da87c68e112 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.217731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 533/1068] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:33.223561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.223993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.224117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.242402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:33.243855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:33.303782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 536/1069] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:33.329312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879ded-15af-4953-9cb3-3da87c68e112 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:33.341250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2879ded-15af-4953-9cb3-3da87c68e112 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:33.346253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:33.347035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.347318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.347593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.357522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:33.365726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:33.367172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 534/1070] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:33.373419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:33.383004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05388cca-cef7-4d58-995a-27958bef4762 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:33.387499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:33.388152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.388436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.388712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.389468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:33.389774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:33.391541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:33.408135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 537/1071] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:33.414976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:33.425735 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267d93b-1bba-442f-b6d4-7de7928e1b7f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:33.430364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:33.431199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.431475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.431744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] PATH_INFO: `/v3/users/20f9187a89154c16ad71ee72fe251c3b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.449473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] RBAC: Authorizing `identity:get_user(user_id=20f9187a89154c16ad71ee72fe251c3b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:33.451662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:33.453369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 535/1072] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:33 2022] GET /identity/v3/users/20f9187a89154c16ad71ee72fe251c3b => generated 285 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:33.459297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:33.469181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324ebda-7d7a-45f1-b66a-724ee7a6b57b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:33.477702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:33.478411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.478690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.478962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.488351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:33.490128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:33.503048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 538/1073] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:17:33.506287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:33.515889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4e656-f1f5-4be7-ba0d-6956d7c74114 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:33.521139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d02a3-786f-463b-9bb0-ca5eabf7543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:33.522048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d02a3-786f-463b-9bb0-ca5eabf7543b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.522424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d02a3-786f-463b-9bb0-ca5eabf7543b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.522767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d02a3-786f-463b-9bb0-ca5eabf7543b admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.524005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d02a3-786f-463b-9bb0-ca5eabf7543b admin admin] RBAC: Authorizing `identity:get_project(project_id=8b42e88479f8489c90ddb025f891fe66)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:33.526099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d02a3-786f-463b-9bb0-ca5eabf7543b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:33.527765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 536/1074] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:33 2022] GET /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:33.534692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:33.543509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699f179-b79e-4628-b0c4-73f1745b4022 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:33.548121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:33.548755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:33.549035 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:33.549306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:33.550141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8b42e88479f8489c90ddb025f891fe66, user.id=20f9187a89154c16ad71ee72fe251c3b) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:33.550483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:33.552335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c281a-a79f-455a-bdc0-52b8db810474 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:33.557809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 539/1075] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:33 2022] GET /identity/v3/role_assignments?user.id=20f9187a89154c16ad71ee72fe251c3b&scope.project.id=8b42e88479f8489c90ddb025f891fe66&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:34.486550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be09b5-e9f0-4667-ad96-216bb95feaf6 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.486550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be09b5-e9f0-4667-ad96-216bb95feaf6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.486550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be09b5-e9f0-4667-ad96-216bb95feaf6 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.487776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 537/1076] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:34.493250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.493688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.493806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.511358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:34.512540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:34.520654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 540/1077] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:34.546203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be09b5-e9f0-4667-ad96-216bb95feaf6 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.558404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be09b5-e9f0-4667-ad96-216bb95feaf6 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.562668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.563696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.563967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.564232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.574029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:34.581773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 11:17:34.582975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 538/1078] 10.222.0.20 () {56 vars in 1141 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:34.589172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.598795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d551e-4b0a-4b53-82f8-60e95d3428e7 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.603260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.603913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.604192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.604465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.605223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:34.605526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.607154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.615792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 541/1079] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:34.622154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.632999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad2810-37b0-44a5-8d42-f982263a947b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.637437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.638194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.638504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.638771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.650532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.652391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.670198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:34.671488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 539/1080] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:34.677841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.688908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6886b-7921-4473-a4d0-96eeaf94a1ea admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.693758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.694472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.694759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.695034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.695789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:34.696097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.697765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.711659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 542/1081] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:34.717375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.727676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410ce6e-778e-440e-905f-3c86ec392d12 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.732188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.732966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.733248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.733525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.741664 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.743917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.757244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 11:17:34.758412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 540/1082] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:34.764139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.773883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e6cb6-6c5e-4d30-9622-93cde6f115cd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.778421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.779143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.779481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.779817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.780719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:34.781089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.783513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.800797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 543/1083] 10.222.0.20 () {56 vars in 1154 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:34.806440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.815876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813753b-45dd-4ba6-a4df-23972b6254b2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.820277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.820911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.821224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.821527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.829667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.831450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.840376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 541/1084] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:17:34.847140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.856723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbacb1-aacc-4378-94e2-8ecc453ab6e1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.862399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.863197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.863477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.863744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.874002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.876555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.893401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:17:34.894596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 544/1085] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:34.900225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.911421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d602b-296d-4d4a-bf0e-c56a391f0248 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.915886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.916543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.916854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.917157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.917912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:34.918260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.919872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.932285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 542/1086] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:34.938593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.948380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8b03-2664-4871-9f9e-007e13228df8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.952998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.953850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.954127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.954415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.961284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:34.963293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:34.976640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:17:34.977820 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 545/1087] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:34.983538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:34.993400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c236b07-1773-45d5-ad76-b27a1bf5a898 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:34.997690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:34.998351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:34.998646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:34.998895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:34.999681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:34.999981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:35.002546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2052bb6-5473-49a0-bb6b-978a9689e176 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:35.014182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 543/1088] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:35.021211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:35.031329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cbcfa-2075-4d84-b26a-0e7322493dbf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:35.036055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:35.036682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:35.036953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:35.037218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:35.038043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] RBAC: Adding query filter params (role.id=7446d3c1ada747cbaea2c5a13209f7d1, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=df05886e51f34628a524477b98227f40) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:35.038380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:35.040215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3e37a-8057-4885-936c-8ed6442f9e0d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:35.046080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 546/1089] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:35 2022] GET /identity/v3/role_assignments?user.id=df05886e51f34628a524477b98227f40&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=7446d3c1ada747cbaea2c5a13209f7d1 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:35.965688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b767a-dde6-4589-9222-248aaa853b15 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:35.966186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b767a-dde6-4589-9222-248aaa853b15 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:35.966186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b767a-dde6-4589-9222-248aaa853b15 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:35.967942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 544/1090] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:35.973589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:35.974042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:35.974137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:35.991535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:35.992989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:36.001398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 547/1091] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:36.026236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b767a-dde6-4589-9222-248aaa853b15 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:36.039440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b767a-dde6-4589-9222-248aaa853b15 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:36.043991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:36.044983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:36.045262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:36.045533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:36.057486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:36.064955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:36.066181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 545/1092] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:36.072438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:36.082449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ec8b-145d-4669-87f4-73e116b041cf None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:36.087106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:36.087796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:36.088079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:36.088355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:36.089138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:36.089447 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:36.091147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:36.101279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 548/1093] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:36.107182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:36.119586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd88b-8cc4-4caf-a621-cbb6ecbeef78 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:36.124154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:36.125777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:36.126034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:36.126391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] PATH_INFO: `/v3/users/20f9187a89154c16ad71ee72fe251c3b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:36.127691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] RBAC: Authorizing `identity:get_user(user_id=20f9187a89154c16ad71ee72fe251c3b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:36.129858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:36.131552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 546/1094] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:36 2022] GET /identity/v3/users/20f9187a89154c16ad71ee72fe251c3b => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:36.137543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:36.147533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c4f92-7a84-4891-811e-00d409fc8740 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:36.152065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36ca5e-4d7c-4c3a-912e-42b5083405e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:36.152941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ca5e-4d7c-4c3a-912e-42b5083405e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:36.153201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ca5e-4d7c-4c3a-912e-42b5083405e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:36.153467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ca5e-4d7c-4c3a-912e-42b5083405e5 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:36.154704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36ca5e-4d7c-4c3a-912e-42b5083405e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b42e88479f8489c90ddb025f891fe66)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:36.157333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36ca5e-4d7c-4c3a-912e-42b5083405e5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:36.159110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 549/1095] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:36 2022] GET /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:36.165240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:36.176001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cc2fc-2a4c-4978-8243-9738a72df672 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:36.180558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58add808-7e70-4851-ab32-45ee81a216f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:36.181450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add808-7e70-4851-ab32-45ee81a216f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:36.181734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add808-7e70-4851-ab32-45ee81a216f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:36.182010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58add808-7e70-4851-ab32-45ee81a216f0 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66/users/20f9187a89154c16ad71ee72fe251c3b/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:36.184060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add808-7e70-4851-ab32-45ee81a216f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b42e88479f8489c90ddb025f891fe66, user_id=20f9187a89154c16ad71ee72fe251c3b, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:36.186794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58add808-7e70-4851-ab32-45ee81a216f0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:36.294339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 547/1096] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:17:36 2022] PUT /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66/users/20f9187a89154c16ad71ee72fe251c3b/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:17:38.742572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e79f9-75e1-4980-bcdd-9378d15c1565 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:38.743102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e79f9-75e1-4980-bcdd-9378d15c1565 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:38.743102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e79f9-75e1-4980-bcdd-9378d15c1565 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:38.744895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 550/1097] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:38.750722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:38.751130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:38.751268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:38.768867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:38.769974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:38.826491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 548/1098] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:38.851978 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e79f9-75e1-4980-bcdd-9378d15c1565 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:38.864678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e79f9-75e1-4980-bcdd-9378d15c1565 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:38.869205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:38.870011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:38.870315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:38.870587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:38.882118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:38.888922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:38.890091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 551/1099] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:38.896005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:38.904829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a053f-337d-42c9-b8ac-90f9df951b80 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:38.909386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:38.910030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:38.910339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:38.910611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:38.911366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:38.911669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:38.913250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:38.921693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 549/1100] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:38.927646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:38.938286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a775e-bbc6-4523-b78e-65dab96a27d2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:38.942870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:38.943738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:38.944021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:38.944295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] PATH_INFO: `/v3/users/20f9187a89154c16ad71ee72fe251c3b` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:38.945487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] RBAC: Authorizing `identity:get_user(user_id=20f9187a89154c16ad71ee72fe251c3b)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:38.947689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:38.949252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 552/1101] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:38 2022] GET /identity/v3/users/20f9187a89154c16ad71ee72fe251c3b => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:38.954610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:38.963976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c2209-d3b1-46a5-b347-a9a7e27e4828 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:38.968599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:38.969211 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:38.969491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:38.969764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:38.977242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:38.979011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:38.987956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 550/1102] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:38.993741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:39.004014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e604c-15f4-4aea-87e0-f94ce8a01f02 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:39.008472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a99659-7776-47d4-ae63-9f461c179ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:39.009298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a99659-7776-47d4-ae63-9f461c179ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:39.009575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a99659-7776-47d4-ae63-9f461c179ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:39.009843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a99659-7776-47d4-ae63-9f461c179ae5 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:39.011041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a99659-7776-47d4-ae63-9f461c179ae5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b42e88479f8489c90ddb025f891fe66)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:39.013067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a99659-7776-47d4-ae63-9f461c179ae5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:39.014720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 553/1103] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:38 2022] GET /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:39.020572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:39.029409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7066d-2b02-4fb3-8849-3de0572426bc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:39.033966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:39.034724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:39.035003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:39.035271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:39.036092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8b42e88479f8489c90ddb025f891fe66, user.id=20f9187a89154c16ad71ee72fe251c3b) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:39.036393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:39.038466 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2e782-c02e-4da0-8ce3-519c696d3260 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:39.044002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 551/1104] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:39 2022] GET /identity/v3/role_assignments?user.id=20f9187a89154c16ad71ee72fe251c3b&scope.project.id=8b42e88479f8489c90ddb025f891fe66&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:41.497942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174a60d-ff14-4208-ae8b-f326fe40efa9 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:41.498497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174a60d-ff14-4208-ae8b-f326fe40efa9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:41.498497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174a60d-ff14-4208-ae8b-f326fe40efa9 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:41.500781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 554/1105] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:41.506067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:41.506478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:41.506659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:41.523977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:41.525150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:41.533953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 552/1106] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:41.561741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174a60d-ff14-4208-ae8b-f326fe40efa9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:41.574719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174a60d-ff14-4208-ae8b-f326fe40efa9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:41.579063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ea026-e524-4781-abd6-a0e5f84af3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:41.579828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea026-e524-4781-abd6-a0e5f84af3af admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:41.580101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea026-e524-4781-abd6-a0e5f84af3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:41.580367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea026-e524-4781-abd6-a0e5f84af3af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:41.581518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ea026-e524-4781-abd6-a0e5f84af3af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:41.583226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ea026-e524-4781-abd6-a0e5f84af3af admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:41.584782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 555/1107] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:41.590609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:41.600043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67c2ef-c660-40b8-94b0-2fdba7485b83 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:41.604502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0f3c4-de59-48ec-9f3e-55572de86aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:41.605143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0f3c4-de59-48ec-9f3e-55572de86aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:41.605426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0f3c4-de59-48ec-9f3e-55572de86aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:41.605698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0f3c4-de59-48ec-9f3e-55572de86aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:41.606450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0f3c4-de59-48ec-9f3e-55572de86aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:41.609162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0f3c4-de59-48ec-9f3e-55572de86aa0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:41.677693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 553/1108] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:17:41 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:44.152104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431cfc0-b9ec-4864-b8c0-3e071ad7a144 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.152657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431cfc0-b9ec-4864-b8c0-3e071ad7a144 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.152657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431cfc0-b9ec-4864-b8c0-3e071ad7a144 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.154454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 556/1109] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:44.159946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.160347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.160511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.178232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:44.179413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:44.187106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 554/1110] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:44.213201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431cfc0-b9ec-4864-b8c0-3e071ad7a144 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:44.226203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431cfc0-b9ec-4864-b8c0-3e071ad7a144 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:44.230649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:44.231483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.231755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.232026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] PATH_INFO: `/v3/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.233679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] RBAC: Authorizing `identity:get_role(role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:44.234737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:17:44.234737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:17:44.234737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:17:44.235613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:44.236940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 557/1111] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:44 2022] GET /identity/v3/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:44.243189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:44.252556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024c9b-e34c-4a97-9f84-f3ae21b14f01 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:44.257345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:44.258227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.258522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.258798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] PATH_INFO: `/v3/users/d5d36817ef0e4c8ead108a796779b252` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.274147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5d36817ef0e4c8ead108a796779b252)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:44.276310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:44.277935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 555/1112] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:44 2022] GET /identity/v3/users/d5d36817ef0e4c8ead108a796779b252 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:44.284294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:44.295162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76812bb-9bda-409b-964b-348684a6ad66 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:44.299940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:44.300564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.300846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.301118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.308827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:44.310620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:44.319933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 558/1113] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:44.326770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:44.336589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527571e-36e3-435c-8a0a-e8e2537f6cf2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:44.341115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2abb-89d5-435e-857f-8c45e5eab4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:44.342643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2abb-89d5-435e-857f-8c45e5eab4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.342930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2abb-89d5-435e-857f-8c45e5eab4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.343201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2abb-89d5-435e-857f-8c45e5eab4a6 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.344444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2abb-89d5-435e-857f-8c45e5eab4a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b42e88479f8489c90ddb025f891fe66)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:44.346523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2abb-89d5-435e-857f-8c45e5eab4a6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:44.348198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 556/1114] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:44 2022] GET /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:17:44.354470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:44.363420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75253a8-076c-4844-a491-fc80d980b1c6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:44.368218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:44.368845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:44.369124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:44.369396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:44.370238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] RBAC: Adding query filter params (role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=8b42e88479f8489c90ddb025f891fe66, user.id=d5d36817ef0e4c8ead108a796779b252) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:44.370571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:44.372408 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896d2d4-d106-44e7-8975-b769a2a7f825 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:44.378251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 559/1115] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:44 2022] GET /identity/v3/role_assignments?user.id=d5d36817ef0e4c8ead108a796779b252&scope.project.id=8b42e88479f8489c90ddb025f891fe66&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:46.937930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab68fd-fc9d-410f-91a9-568a07e5bb4e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:46.938467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab68fd-fc9d-410f-91a9-568a07e5bb4e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:46.938467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab68fd-fc9d-410f-91a9-568a07e5bb4e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:46.940311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 557/1116] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:46.945653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:46.946051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:46.946204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:46.963509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:46.964689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:46.972774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 560/1117] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:47.003276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab68fd-fc9d-410f-91a9-568a07e5bb4e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:47.016423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab68fd-fc9d-410f-91a9-568a07e5bb4e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:47.020801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:47.021624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:47.021905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:47.022183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] PATH_INFO: `/v3/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:47.023706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] RBAC: Authorizing `identity:get_role(role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:47.024727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:17:47.024727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:17:47.024727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:17:47.025598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:47.026961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 558/1118] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:47 2022] GET /identity/v3/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:47.033387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:47.042206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a298f2-2ece-4454-8be0-d017f27e71c9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:47.046723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:47.047566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:47.047845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:47.048116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] PATH_INFO: `/v3/users/d5d36817ef0e4c8ead108a796779b252` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:47.049309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5d36817ef0e4c8ead108a796779b252)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:47.051464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:47.053013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 561/1119] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:47 2022] GET /identity/v3/users/d5d36817ef0e4c8ead108a796779b252 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:47.058647 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:47.068706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60bcb7-33ee-4dda-8362-e05f2152190f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:47.073492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dd67b-9e50-4f65-93e4-93ff09282986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:47.074377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd67b-9e50-4f65-93e4-93ff09282986 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:47.074661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd67b-9e50-4f65-93e4-93ff09282986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:47.074939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd67b-9e50-4f65-93e4-93ff09282986 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:47.077194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dd67b-9e50-4f65-93e4-93ff09282986 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b42e88479f8489c90ddb025f891fe66)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:47.079292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dd67b-9e50-4f65-93e4-93ff09282986 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:47.080945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 559/1120] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:47 2022] GET /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:47.086735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:47.096935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd4f85-9ece-4938-8738-c423bf3da414 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:47.101284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f233-9eb0-4dde-81f3-7dde0df28018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:47.102138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f233-9eb0-4dde-81f3-7dde0df28018 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:47.102449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f233-9eb0-4dde-81f3-7dde0df28018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:47.102721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f233-9eb0-4dde-81f3-7dde0df28018 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66/users/d5d36817ef0e4c8ead108a796779b252/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:47.104874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f233-9eb0-4dde-81f3-7dde0df28018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b42e88479f8489c90ddb025f891fe66, user_id=d5d36817ef0e4c8ead108a796779b252, role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:47.108136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f233-9eb0-4dde-81f3-7dde0df28018 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:47.219536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 562/1121] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:17:47 2022] PUT /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66/users/d5d36817ef0e4c8ead108a796779b252/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:17:49.632092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a584d-2b82-4e7e-a8d1-d204956a33f5 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.632629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a584d-2b82-4e7e-a8d1-d204956a33f5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.633088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a584d-2b82-4e7e-a8d1-d204956a33f5 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.636511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 560/1122] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:49.642571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.643110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.643110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.662317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:49.663530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:49.723173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 563/1123] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:49.749422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a584d-2b82-4e7e-a8d1-d204956a33f5 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:49.761405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a584d-2b82-4e7e-a8d1-d204956a33f5 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:49.765703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:49.766599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.766880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.767154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] PATH_INFO: `/v3/roles/bc097af8156645dbab68d6bd75ef6bfb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.768610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] RBAC: Authorizing `identity:get_role(role_id=bc097af8156645dbab68d6bd75ef6bfb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:49.770193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:49.771522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 561/1124] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:49 2022] GET /identity/v3/roles/bc097af8156645dbab68d6bd75ef6bfb => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:49.777201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:49.787858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4aa82-3882-48e4-8dc3-8222e537a6ee None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:49.792547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:49.793437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.793717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.794047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] PATH_INFO: `/v3/users/d5d36817ef0e4c8ead108a796779b252` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.796618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] RBAC: Authorizing `identity:get_user(user_id=d5d36817ef0e4c8ead108a796779b252)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:49.798815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:49.800490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 564/1125] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:49 2022] GET /identity/v3/users/d5d36817ef0e4c8ead108a796779b252 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:49.806340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:49.816850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554902ee-ae68-4759-b067-b6d0729650ee admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:49.821372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:49.822001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.822312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.822584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.831660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:49.833404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:49.842610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 562/1126] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:49.848625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:49.859354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217020f4-8b0b-4f15-b80d-0f59bcbda618 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:49.863839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f473bc5-aca9-40ee-b79b-9f63e24c6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:49.864956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473bc5-aca9-40ee-b79b-9f63e24c6f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.865239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473bc5-aca9-40ee-b79b-9f63e24c6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.865514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f473bc5-aca9-40ee-b79b-9f63e24c6f17 admin admin] PATH_INFO: `/v3/projects/8b42e88479f8489c90ddb025f891fe66` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.866729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473bc5-aca9-40ee-b79b-9f63e24c6f17 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b42e88479f8489c90ddb025f891fe66)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:49.869170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f473bc5-aca9-40ee-b79b-9f63e24c6f17 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:49.871065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 565/1127] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:49 2022] GET /identity/v3/projects/8b42e88479f8489c90ddb025f891fe66 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:49.878631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:49.887367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4e62-eda6-435a-aba5-8fbee22d9d13 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:49.892667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:49.893295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:49.893570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:49.893841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:49.894706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] RBAC: Adding query filter params (role.id=bc097af8156645dbab68d6bd75ef6bfb, scope.project.id=8b42e88479f8489c90ddb025f891fe66, user.id=d5d36817ef0e4c8ead108a796779b252) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:49.895014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:49.896850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b9011-a469-405f-b92d-0cb0345828f2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:49.902796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 563/1128] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:49 2022] GET /identity/v3/role_assignments?user.id=d5d36817ef0e4c8ead108a796779b252&scope.project.id=8b42e88479f8489c90ddb025f891fe66&role.id=bc097af8156645dbab68d6bd75ef6bfb => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:52.413260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e793a-9bcc-493a-b999-a7bc15835a39 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:52.413792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e793a-9bcc-493a-b999-a7bc15835a39 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:52.413792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e793a-9bcc-493a-b999-a7bc15835a39 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:52.415561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 566/1129] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:52.420828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:52.421310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:52.421405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:52.438451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:52.439624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:52.447197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 564/1130] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:52.473396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e793a-9bcc-493a-b999-a7bc15835a39 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:52.486091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e793a-9bcc-493a-b999-a7bc15835a39 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:52.490773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663a40f-d739-493e-9791-c8e74cfc3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:52.491551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663a40f-d739-493e-9791-c8e74cfc3024 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:52.491829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663a40f-d739-493e-9791-c8e74cfc3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:52.492101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663a40f-d739-493e-9791-c8e74cfc3024 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:52.493272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663a40f-d739-493e-9791-c8e74cfc3024 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:52.495019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663a40f-d739-493e-9791-c8e74cfc3024 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:52.496587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 567/1131] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:52.503565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:52.518687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e2831-ba66-44a5-a01f-721f2a5ae528 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:52.525873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb4b48-b169-4e1a-bfc3-ffab61b9a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:52.526962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4b48-b169-4e1a-bfc3-ffab61b9a7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:52.527439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4b48-b169-4e1a-bfc3-ffab61b9a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:52.527940 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4b48-b169-4e1a-bfc3-ffab61b9a7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:52.529232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb4b48-b169-4e1a-bfc3-ffab61b9a7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:52.532721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb4b48-b169-4e1a-bfc3-ffab61b9a7d9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:52.630803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 565/1132] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:17:52 2022] POST /identity/v3/projects => generated 311 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:55.097608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1654-6a56-41f4-9c87-2cd3dad78b03 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:55.098152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1654-6a56-41f4-9c87-2cd3dad78b03 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:55.098152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c1654-6a56-41f4-9c87-2cd3dad78b03 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:55.099941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 568/1133] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:55.105366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:55.105821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:55.106188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:55.124248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:55.125425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:55.182967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 566/1134] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:55.211041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c1654-6a56-41f4-9c87-2cd3dad78b03 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:55.223116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c1654-6a56-41f4-9c87-2cd3dad78b03 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:55.227373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef24da-90e8-4c48-8e24-dd2aca503a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:55.228135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef24da-90e8-4c48-8e24-dd2aca503a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:55.228419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef24da-90e8-4c48-8e24-dd2aca503a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:55.228690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef24da-90e8-4c48-8e24-dd2aca503a3f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:55.229848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef24da-90e8-4c48-8e24-dd2aca503a3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:55.231864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef24da-90e8-4c48-8e24-dd2aca503a3f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:55.233417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 569/1135] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:17:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:55.239279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:55.248964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225aa25-7aa7-4449-b2f8-c92736624f5a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:55.253711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822807bc-aef1-42dc-a9c9-ac95c61172b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:55.254393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822807bc-aef1-42dc-a9c9-ac95c61172b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:55.254673 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822807bc-aef1-42dc-a9c9-ac95c61172b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:55.254943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822807bc-aef1-42dc-a9c9-ac95c61172b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:55.255665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822807bc-aef1-42dc-a9c9-ac95c61172b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:55.257590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822807bc-aef1-42dc-a9c9-ac95c61172b1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:55.389242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 567/1136] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:17:55 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:17:57.946078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c1c3-e373-413b-878c-73eba591fccf None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:57.946620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c1c3-e373-413b-878c-73eba591fccf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:57.946620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736c1c3-e373-413b-878c-73eba591fccf None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:57.948303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 570/1137] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:17:57.954240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:57.954719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:57.954811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:57.972766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:17:57.973946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:17:57.982336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 568/1138] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:17:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:17:58.008999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c1c3-e373-413b-878c-73eba591fccf None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:58.021869 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736c1c3-e373-413b-878c-73eba591fccf None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:58.026276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:58.027546 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:58.027914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:58.028193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:58.038547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:17:58.045698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:17:58.046946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 571/1139] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:17:58.053006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:58.062435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21abeb3-e8aa-4831-9e1c-f7c9d78901ed None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:58.067071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:58.067716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:58.067994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:58.068265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:58.069017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:58.069318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:58.071004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:58.080739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 569/1140] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:58.086576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:58.096762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a784550-9634-4d55-a50d-51ac92baa3d6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:58.101323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:58.102170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:58.102487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:58.102760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] PATH_INFO: `/v3/users/3caafeb8c99e45bc91e0aad78a056dcb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:58.116307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] RBAC: Authorizing `identity:get_user(user_id=3caafeb8c99e45bc91e0aad78a056dcb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:58.118525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:58.120185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 572/1141] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:17:58 2022] GET /identity/v3/users/3caafeb8c99e45bc91e0aad78a056dcb => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:58.126928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:58.138039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54e71f-d2a5-46ca-a1e2-7fa7559d98f7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:58.142622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:58.143261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:58.143544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:58.143815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:58.152164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:58.153945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:58.163715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 570/1142] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:17:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:17:58.169979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:58.179949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aa65f-f221-4650-8514-63f9ae39e176 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:58.185054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229db6fe-db56-4211-b349-74f41a0f283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:58.185895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229db6fe-db56-4211-b349-74f41a0f283c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:58.186174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229db6fe-db56-4211-b349-74f41a0f283c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:58.186476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229db6fe-db56-4211-b349-74f41a0f283c admin admin] PATH_INFO: `/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:58.187666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229db6fe-db56-4211-b349-74f41a0f283c admin admin] RBAC: Authorizing `identity:get_project(project_id=606d5d28bda54f4d8c366d7dfc11f3d9)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:58.189703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229db6fe-db56-4211-b349-74f41a0f283c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:58.191391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 573/1143] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:17:58 2022] GET /identity/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:17:58.197531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:17:58.206887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39488b6f-4a4e-4766-818a-ed75c713708d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:17:58.211384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:17:58.212010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:17:58.212285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:17:58.212562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:17:58.213400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=606d5d28bda54f4d8c366d7dfc11f3d9, user.id=3caafeb8c99e45bc91e0aad78a056dcb) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:17:58.213704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:17:58.215604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f844-f72b-4e07-be32-9ebf3db754aa admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:17:58.221212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 571/1144] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:17:58 2022] GET /identity/v3/role_assignments?user.id=3caafeb8c99e45bc91e0aad78a056dcb&scope.project.id=606d5d28bda54f4d8c366d7dfc11f3d9&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:00.645356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832075-0ca3-4b1e-a47a-b80a8e12c511 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.645932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832075-0ca3-4b1e-a47a-b80a8e12c511 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.645932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832075-0ca3-4b1e-a47a-b80a8e12c511 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.647708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 574/1145] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:00.653230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.653692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.653795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.671586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:00.672772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:00.680326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 572/1146] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:00.706483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832075-0ca3-4b1e-a47a-b80a8e12c511 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:00.718832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832075-0ca3-4b1e-a47a-b80a8e12c511 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:00.725128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:00.725902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.726181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.726500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.737673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:18:00.744724 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:18:00.746998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 575/1147] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:18:00.752994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:00.763775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38ecd4-c637-4288-9c96-85a52bc9a8aa None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:00.768204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:00.768855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.769138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.769412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.770165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:00.770500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:00.772083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:00.780258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 573/1148] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:00.785930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:00.797254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec703d-bfdb-4047-857a-06eb7ef5572a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:00.801760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:00.802646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.802927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.803201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] PATH_INFO: `/v3/users/3caafeb8c99e45bc91e0aad78a056dcb` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.804403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] RBAC: Authorizing `identity:get_user(user_id=3caafeb8c99e45bc91e0aad78a056dcb)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:00.806573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:00.809229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 576/1149] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:18:00 2022] GET /identity/v3/users/3caafeb8c99e45bc91e0aad78a056dcb => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:00.814893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:00.824463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296803d-c234-42de-ab0b-9ae9e779f0f6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:00.828950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791947f-f4d9-4640-8421-cff9fbfe54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:00.829778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791947f-f4d9-4640-8421-cff9fbfe54e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.830060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791947f-f4d9-4640-8421-cff9fbfe54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.830380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791947f-f4d9-4640-8421-cff9fbfe54e7 admin admin] PATH_INFO: `/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.831550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791947f-f4d9-4640-8421-cff9fbfe54e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=606d5d28bda54f4d8c366d7dfc11f3d9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:00.833584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791947f-f4d9-4640-8421-cff9fbfe54e7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:00.835264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 574/1150] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:18:00 2022] GET /identity/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:00.841120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:00.850756 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85f56-ba08-4a94-b001-a9ebc4c9e23c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:00.855707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b8075-8b46-4d11-be7b-202df8a17b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:00.856565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8075-8b46-4d11-be7b-202df8a17b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:00.856844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8075-8b46-4d11-be7b-202df8a17b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:00.857116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b8075-8b46-4d11-be7b-202df8a17b48 admin admin] PATH_INFO: `/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9/users/3caafeb8c99e45bc91e0aad78a056dcb/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:00.859114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8075-8b46-4d11-be7b-202df8a17b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606d5d28bda54f4d8c366d7dfc11f3d9, user_id=3caafeb8c99e45bc91e0aad78a056dcb, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:00.861787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b8075-8b46-4d11-be7b-202df8a17b48 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:00.942618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 577/1151] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:18:00 2022] PUT /identity/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9/users/3caafeb8c99e45bc91e0aad78a056dcb/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:18:03.436460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb722b-c969-431e-8b65-fb36c2303020 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.437022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb722b-c969-431e-8b65-fb36c2303020 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.437022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb722b-c969-431e-8b65-fb36c2303020 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.438818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 575/1152] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:03.443842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c921-efc7-478a-841e-be14aef84089 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.444226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c921-efc7-478a-841e-be14aef84089 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.444391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624c921-efc7-478a-841e-be14aef84089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.461551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b624c921-efc7-478a-841e-be14aef84089 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:03.462757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b624c921-efc7-478a-841e-be14aef84089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:03.521212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 578/1153] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:03.547247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb722b-c969-431e-8b65-fb36c2303020 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:03.560602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb722b-c969-431e-8b65-fb36c2303020 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:03.565260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:03.566061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.566397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.566680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.579033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:18:03.585884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:18:03.587148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 576/1154] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:18:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:18:03.593460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c921-efc7-478a-841e-be14aef84089 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:03.602510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624c921-efc7-478a-841e-be14aef84089 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:03.608128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:03.608779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.609060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.609334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.610095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:03.610433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:03.612059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:03.621760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 579/1155] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:03.627563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:03.638626 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566f261-5294-4723-94ce-5173e19a7ca6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:03.643320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:03.644161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.644440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.644710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] PATH_INFO: `/v3/users/3caafeb8c99e45bc91e0aad78a056dcb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.645921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] RBAC: Authorizing `identity:get_user(user_id=3caafeb8c99e45bc91e0aad78a056dcb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:03.648130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:03.649835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 577/1156] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:18:03 2022] GET /identity/v3/users/3caafeb8c99e45bc91e0aad78a056dcb => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:03.656085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:03.665651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6417c1f-235e-44d2-9d59-a2d13d236bcd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:03.671234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:03.671867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.672150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.672590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.681412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:03.684533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:03.694141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 580/1157] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:18:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:18:03.700954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:03.710617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954d28-adf1-46b3-b140-23bf1dd5cc15 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:03.715079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66605fd3-14ce-485c-9eb5-bc44eb510377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:03.716215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66605fd3-14ce-485c-9eb5-bc44eb510377 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.716494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66605fd3-14ce-485c-9eb5-bc44eb510377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.716768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66605fd3-14ce-485c-9eb5-bc44eb510377 admin admin] PATH_INFO: `/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.717936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66605fd3-14ce-485c-9eb5-bc44eb510377 admin admin] RBAC: Authorizing `identity:get_project(project_id=606d5d28bda54f4d8c366d7dfc11f3d9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:03.720015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66605fd3-14ce-485c-9eb5-bc44eb510377 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:03.721650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 578/1158] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:18:03 2022] GET /identity/v3/projects/606d5d28bda54f4d8c366d7dfc11f3d9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:03.727574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:03.738584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eef54-4bae-4035-a858-a7143c4fc90d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:03.746719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:03.747867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:03.748368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:03.748868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:03.750513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=606d5d28bda54f4d8c366d7dfc11f3d9, user.id=3caafeb8c99e45bc91e0aad78a056dcb) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:03.751073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:03.754672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c433d-bf07-4bd0-9de4-ce7c43c55b13 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:03.763554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 581/1159] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:18:03 2022] GET /identity/v3/role_assignments?user.id=3caafeb8c99e45bc91e0aad78a056dcb&scope.project.id=606d5d28bda54f4d8c366d7dfc11f3d9&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:06.201888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82deed8-f06a-4b5b-9274-390138a0d97b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:06.202481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82deed8-f06a-4b5b-9274-390138a0d97b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:06.202481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82deed8-f06a-4b5b-9274-390138a0d97b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:06.204221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 579/1160] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:06.211893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:06.212366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:06.212469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:06.232572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:06.233766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:06.241665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 582/1161] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:06.264632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82deed8-f06a-4b5b-9274-390138a0d97b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:06.277135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82deed8-f06a-4b5b-9274-390138a0d97b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:06.281865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:06.282533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:06.282816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:06.283090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:06.290815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:06.293388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:06.302001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 580/1162] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:18:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:18:06.308478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:06.317197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eb7a2-6c91-47f4-ab91-a18c5e7f8691 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:06.321649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:06.322456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:06.322739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:06.323580 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:06.330310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:06.332132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:06.345894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-98228d6f-6078-4947-9dde-04f1c44702a7 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 10 11:18:06.347069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 583/1163] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:18:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:18:06.352821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:06.361543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fb08c-3834-4fb6-b713-7fa3af99fb83 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:06.366280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:06.366911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:06.367192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:06.367467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:06.368190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:06.368493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:06.370656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2b0b4-db43-48e2-a345-dd6fb80fed42 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:06.377745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 581/1164] 10.222.0.20 () {56 vars in 1136 bytes} [Mon Jan 10 11:18:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:08.785261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7036b6-b7e7-41ea-b5a8-c373f128b364 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:08.785783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7036b6-b7e7-41ea-b5a8-c373f128b364 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:08.785783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7036b6-b7e7-41ea-b5a8-c373f128b364 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:08.787517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 584/1165] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:08.794827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36da47-67c3-401b-b9fd-00f4d008fc22 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:08.795265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36da47-67c3-401b-b9fd-00f4d008fc22 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:08.795384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36da47-67c3-401b-b9fd-00f4d008fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:08.813485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-df36da47-67c3-401b-b9fd-00f4d008fc22 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:08.814709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-df36da47-67c3-401b-b9fd-00f4d008fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:08.822405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 582/1166] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:08.847927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7036b6-b7e7-41ea-b5a8-c373f128b364 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:08.860902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7036b6-b7e7-41ea-b5a8-c373f128b364 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:08.865457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:08.866082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:08.866404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:08.866683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:08.867423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:08.868451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:18:08.868451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:18:08.868451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:18:08.869322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd68a4-6f50-4df7-85e4-83e14da51836 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:08.965995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 585/1167] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Jan 10 11:18:08 2022] POST /identity/v3/domains => generated 267 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:18:11.401976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe12a5-9a23-4343-ab4d-780102a67ea4 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:11.402570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe12a5-9a23-4343-ab4d-780102a67ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:11.402570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe12a5-9a23-4343-ab4d-780102a67ea4 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:11.404336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 583/1168] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:11.409523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:11.409931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:11.410180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:11.428541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:11.429727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:11.486029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 586/1169] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:18:11.512474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe12a5-9a23-4343-ab4d-780102a67ea4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:11.524384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe12a5-9a23-4343-ab4d-780102a67ea4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:11.529799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e4dc-93ff-459e-8cb2-86e1e19eab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:11.530668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e4dc-93ff-459e-8cb2-86e1e19eab9f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:11.530953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e4dc-93ff-459e-8cb2-86e1e19eab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:11.531228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e4dc-93ff-459e-8cb2-86e1e19eab9f admin admin] PATH_INFO: `/v3/domains/791379736279482aac302affcb1f731d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:11.542359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e4dc-93ff-459e-8cb2-86e1e19eab9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=791379736279482aac302affcb1f731d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:11.544318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4e4dc-93ff-459e-8cb2-86e1e19eab9f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:11.545916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 584/1170] 10.222.0.20 () {56 vars in 1204 bytes} [Mon Jan 10 11:18:11 2022] GET /identity/v3/domains/791379736279482aac302affcb1f731d => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:11.551658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:11.561472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15939c-8c90-457e-94b5-6e6cba952e69 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:11.565962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dccb7-b968-4df3-83fc-4be66cafb8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:11.566639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dccb7-b968-4df3-83fc-4be66cafb8ea admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:11.566921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dccb7-b968-4df3-83fc-4be66cafb8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:11.567194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dccb7-b968-4df3-83fc-4be66cafb8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:11.567905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dccb7-b968-4df3-83fc-4be66cafb8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:11.569793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dccb7-b968-4df3-83fc-4be66cafb8ea admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:11.673304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 587/1171] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:18:11 2022] POST /identity/v3/projects => generated 361 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:18:14.114933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0d720-9856-429f-8545-5d9248ab51a8 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:14.115460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0d720-9856-429f-8545-5d9248ab51a8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:14.115460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0d720-9856-429f-8545-5d9248ab51a8 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:14.117248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 585/1172] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:14.122941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:14.123389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:14.123485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:14.140637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:14.141803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:14.196130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 588/1173] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:14.223184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0d720-9856-429f-8545-5d9248ab51a8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:14.235898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0d720-9856-429f-8545-5d9248ab51a8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:14.240488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388ca85-3248-4272-bd36-6454d186d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:14.241319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388ca85-3248-4272-bd36-6454d186d606 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:14.241600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388ca85-3248-4272-bd36-6454d186d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:14.241874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388ca85-3248-4272-bd36-6454d186d606 admin admin] PATH_INFO: `/v3/domains/791379736279482aac302affcb1f731d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:14.243076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388ca85-3248-4272-bd36-6454d186d606 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=791379736279482aac302affcb1f731d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:14.245066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388ca85-3248-4272-bd36-6454d186d606 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:14.246672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 586/1174] 10.222.0.20 () {56 vars in 1204 bytes} [Mon Jan 10 11:18:14 2022] GET /identity/v3/domains/791379736279482aac302affcb1f731d => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:14.252453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:14.262372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90033a29-768f-4108-a087-aec2f5a82420 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:14.266873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7d9c-7fad-41b5-a22e-2cf552ff9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:14.267521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7d9c-7fad-41b5-a22e-2cf552ff9db4 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:14.267800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7d9c-7fad-41b5-a22e-2cf552ff9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:14.268073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7d9c-7fad-41b5-a22e-2cf552ff9db4 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:14.268787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7d9c-7fad-41b5-a22e-2cf552ff9db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:14.270739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7d9c-7fad-41b5-a22e-2cf552ff9db4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:14.392865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 589/1175] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:18:14 2022] POST /identity/v3/users => generated 311 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:18:16.849466 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e95dc-3196-4088-bcc3-3d930e8bf486 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:16.849963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e95dc-3196-4088-bcc3-3d930e8bf486 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:16.849963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e95dc-3196-4088-bcc3-3d930e8bf486 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:16.851725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 587/1176] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:16.856909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:16.857354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:16.857455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:16.875422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:16.876602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:16.885636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 590/1177] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:16.910454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e95dc-3196-4088-bcc3-3d930e8bf486 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:16.922573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e95dc-3196-4088-bcc3-3d930e8bf486 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:16.926869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:16.927624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:16.927905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:16.928181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:16.938994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:18:16.945757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:18:16.947676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 588/1178] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:18:16.954998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:16.964217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49f04-e616-490d-b19a-e86a1a4743b1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:16.968773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:16.969425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:16.969703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:16.969970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:16.970754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:16.971055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:16.972657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:16.981250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 591/1179] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:18:16.987341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:16.998062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109883f-399a-41e3-b8af-d310a23f8f67 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:17.002928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:17.003781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:17.004065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:17.004340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] PATH_INFO: `/v3/users/3493cc170b62417c84073e8da7f4ee72` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:17.018617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] RBAC: Authorizing `identity:get_user(user_id=3493cc170b62417c84073e8da7f4ee72)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:17.020753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:17.022396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 589/1180] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:18:16 2022] GET /identity/v3/users/3493cc170b62417c84073e8da7f4ee72 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:17.028038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:17.037356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b93f-d9c8-4a1f-8828-3bc034aa048b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:17.042313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:17.042925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:17.043226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:17.043500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:17.050945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:17.052671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:17.061899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 592/1181] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:18:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:18:17.067815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:17.077901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d69584-0372-49e4-9488-bdba84417a34 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:17.083182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6dbf-fbd2-4f13-a927-25615d1e7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:17.084022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6dbf-fbd2-4f13-a927-25615d1e7bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:17.084301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6dbf-fbd2-4f13-a927-25615d1e7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:17.084576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6dbf-fbd2-4f13-a927-25615d1e7bfb admin admin] PATH_INFO: `/v3/projects/9dac19daf34d487aba28ea70b35650d4` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:17.085742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6dbf-fbd2-4f13-a927-25615d1e7bfb admin admin] RBAC: Authorizing `identity:get_project(project_id=9dac19daf34d487aba28ea70b35650d4)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:17.088140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6dbf-fbd2-4f13-a927-25615d1e7bfb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:17.089801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 590/1182] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:18:17 2022] GET /identity/v3/projects/9dac19daf34d487aba28ea70b35650d4 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:17.095959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:17.105664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73077b6-5bfd-4fb1-8815-cc9a75163f02 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:17.110175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:17.110837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:17.111116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:17.111386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:17.112470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=9dac19daf34d487aba28ea70b35650d4, user.id=3493cc170b62417c84073e8da7f4ee72) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:17.112776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:17.114645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864194-ab52-49fa-944d-886cedd8e690 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:17.120896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 593/1183] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:18:17 2022] GET /identity/v3/role_assignments?user.id=3493cc170b62417c84073e8da7f4ee72&scope.project.id=9dac19daf34d487aba28ea70b35650d4&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:19.527467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1359-cf5f-40f0-91bb-12bf427d87dd None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.527973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1359-cf5f-40f0-91bb-12bf427d87dd None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.528072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1359-cf5f-40f0-91bb-12bf427d87dd None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.529882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 591/1184] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:19.535178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.535608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.535794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.553653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:19.554875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:19.563278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 594/1185] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:19.587686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1359-cf5f-40f0-91bb-12bf427d87dd None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:19.600051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1359-cf5f-40f0-91bb-12bf427d87dd None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:19.605329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:19.606091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.606400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.606677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.616805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:18:19.625343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:18:19.626556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 592/1186] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:18:19.632581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:19.641883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f3219-8e40-42e9-a595-cb1957466eb8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:19.646399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:19.647048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.647329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.647601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.648358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:19.648660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:19.650834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:19.658980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 595/1187] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:19.664906 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:19.675363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568d08a-afa2-4f32-a825-fd13746f7149 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:19.679882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:19.680718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.681047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.681329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] PATH_INFO: `/v3/users/3493cc170b62417c84073e8da7f4ee72` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.682657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] RBAC: Authorizing `identity:get_user(user_id=3493cc170b62417c84073e8da7f4ee72)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:19.684784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:19.686385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 593/1188] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:18:19 2022] GET /identity/v3/users/3493cc170b62417c84073e8da7f4ee72 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:19.691890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:19.701278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb61cd7-051f-433c-8d74-d6dd67bc6b45 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:19.705619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ecea-6d65-4cb4-9d3c-e56584108263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:19.706480 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ecea-6d65-4cb4-9d3c-e56584108263 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.706757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ecea-6d65-4cb4-9d3c-e56584108263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.707026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ecea-6d65-4cb4-9d3c-e56584108263 admin admin] PATH_INFO: `/v3/projects/9dac19daf34d487aba28ea70b35650d4` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.708181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ecea-6d65-4cb4-9d3c-e56584108263 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dac19daf34d487aba28ea70b35650d4)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:19.710234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ecea-6d65-4cb4-9d3c-e56584108263 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:19.711822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 596/1189] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:18:19 2022] GET /identity/v3/projects/9dac19daf34d487aba28ea70b35650d4 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:19.717922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:19.727356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debae3d-67f7-4b3c-b790-13e795831137 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:19.732789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05afa5-df47-40e8-8457-b8bb3a00de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:19.733645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afa5-df47-40e8-8457-b8bb3a00de23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:19.733934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afa5-df47-40e8-8457-b8bb3a00de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:19.734231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05afa5-df47-40e8-8457-b8bb3a00de23 admin admin] PATH_INFO: `/v3/projects/9dac19daf34d487aba28ea70b35650d4/users/3493cc170b62417c84073e8da7f4ee72/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:19.736198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05afa5-df47-40e8-8457-b8bb3a00de23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dac19daf34d487aba28ea70b35650d4, user_id=3493cc170b62417c84073e8da7f4ee72, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:19.739110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05afa5-df47-40e8-8457-b8bb3a00de23 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:19.832591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 594/1190] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:18:19 2022] PUT /identity/v3/projects/9dac19daf34d487aba28ea70b35650d4/users/3493cc170b62417c84073e8da7f4ee72/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:18:22.231772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede3df-eb35-46dc-a885-c08399127106 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.232334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede3df-eb35-46dc-a885-c08399127106 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.232334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede3df-eb35-46dc-a885-c08399127106 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.234059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 597/1191] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:18:22.239590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.240009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.240145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.257897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:18:22.260135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:18:22.315265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 595/1192] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:18:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:18:22.342399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede3df-eb35-46dc-a885-c08399127106 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:22.354272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede3df-eb35-46dc-a885-c08399127106 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:22.358529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:22.359289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.359564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.359833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.369963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:18:22.376677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:18:22.377810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 598/1193] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:18:22.383668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:22.393792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f147ee-45e0-4245-8207-182d5914f2df None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:22.398233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:22.399002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.399352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.400404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.401260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:22.401562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:22.403178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:22.411227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 596/1194] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:22.417078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:22.427175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf45d9a-2399-4164-8bab-e58ccf09d7cf admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:22.431820 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:22.432702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.432933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.433208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] PATH_INFO: `/v3/users/3493cc170b62417c84073e8da7f4ee72` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.434428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] RBAC: Authorizing `identity:get_user(user_id=3493cc170b62417c84073e8da7f4ee72)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:22.436552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:22.438093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 599/1195] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Jan 10 11:18:22 2022] GET /identity/v3/users/3493cc170b62417c84073e8da7f4ee72 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:22.443700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:22.454410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8fd33-b336-4228-b508-36a38801fcd4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:22.458872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:22.459491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.459773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.460047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.468621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:22.470392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:22.479608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 597/1196] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:18:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:18:22.485516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:22.495289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2c831-8262-452f-8e43-fcec05cffd39 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:22.499704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629c607-13ad-460a-9f97-72e059cbd358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:22.500544 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c607-13ad-460a-9f97-72e059cbd358 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.500824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c607-13ad-460a-9f97-72e059cbd358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.501097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629c607-13ad-460a-9f97-72e059cbd358 admin admin] PATH_INFO: `/v3/projects/9dac19daf34d487aba28ea70b35650d4` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.502305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629c607-13ad-460a-9f97-72e059cbd358 admin admin] RBAC: Authorizing `identity:get_project(project_id=9dac19daf34d487aba28ea70b35650d4)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:22.504579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629c607-13ad-460a-9f97-72e059cbd358 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:22.505999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 600/1197] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:18:22 2022] GET /identity/v3/projects/9dac19daf34d487aba28ea70b35650d4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:18:22.513179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:18:22.522180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aca16-bed2-4d41-9070-d8f5487f738f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:18:22.527520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:18:22.528142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:18:22.528535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:18:22.528810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:18:22.529636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=9dac19daf34d487aba28ea70b35650d4, user.id=3493cc170b62417c84073e8da7f4ee72) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:18:22.529939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:18:22.531797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced1e-da5d-4010-8605-6725267160c2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:18:22.537338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 598/1198] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:18:22 2022] GET /identity/v3/role_assignments?user.id=3493cc170b62417c84073e8da7f4ee72&scope.project.id=9dac19daf34d487aba28ea70b35650d4&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:40.813762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e3494-f6e7-4f37-9e65-34f3700017d5 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:40.814385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e3494-f6e7-4f37-9e65-34f3700017d5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:40.814385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e3494-f6e7-4f37-9e65-34f3700017d5 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:40.816074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 601/1199] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:19:40.821895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:40.822411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:40.822521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:40.841165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:40.842439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:40.850109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 599/1200] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:40.877706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e3494-f6e7-4f37-9e65-34f3700017d5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:40.890034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e3494-f6e7-4f37-9e65-34f3700017d5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:40.894533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:40.895271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:40.895553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:40.895826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:40.906725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:40.908579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:40.926227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:40.931618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 602/1201] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:40.934136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:40.943279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025d2da-5bf5-410b-b364-57c5162b10cd None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:40.947973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:40.948617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:40.948892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:40.949160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:40.949886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:40.950183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:40.951858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b9d0c-a3d4-4fd5-81a7-6aa623469392 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:40.964256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 600/1202] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:40.970129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:40.980519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6360-bcf1-4056-94c2-963185c64a4a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:40.985106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafbcee-56ab-47f8-82dd-9c6fe66faf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:40.985803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafbcee-56ab-47f8-82dd-9c6fe66faf7a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:40.986098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafbcee-56ab-47f8-82dd-9c6fe66faf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:40.986391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafbcee-56ab-47f8-82dd-9c6fe66faf7a admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:40.987103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafbcee-56ab-47f8-82dd-9c6fe66faf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:40.989476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafbcee-56ab-47f8-82dd-9c6fe66faf7a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:41.056230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 603/1203] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Jan 10 11:19:40 2022] POST /identity/v3/users => generated 251 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:19:43.568127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330c54-1b76-4ad5-ba54-5cac603559fc None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.569611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330c54-1b76-4ad5-ba54-5cac603559fc None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.569611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330c54-1b76-4ad5-ba54-5cac603559fc None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.570555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 601/1204] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:19:43.576851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.577350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.577495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.596413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:43.603895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:43.605901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 604/1205] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:43.632183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330c54-1b76-4ad5-ba54-5cac603559fc None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.645521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330c54-1b76-4ad5-ba54-5cac603559fc None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.651133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.652311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.652716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.653075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.668511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:19:43.675588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:19:43.676820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 602/1206] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:43.684468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.700512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ffa8-5882-460d-9e5e-1b7b38545b9e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.707992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.709118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.709615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.710100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.711556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:43.712434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:43.715544 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:43.730843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 605/1207] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:43.737039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.748055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb443c5-35af-4a73-9f78-17802f239497 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.752786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.753567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.756750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.756750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.765105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:43.766991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:43.784557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:43.785775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 603/1208] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:19:43.792693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.803287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fffb-f5e0-4f76-8f5f-3ee61d1c9e38 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.808071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.808726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.809028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.809279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.810033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:43.810347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:43.811957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:43.824982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 606/1209] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:43.831184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.841915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec62d5b-8ba5-407a-824a-6d2cd4b451d6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.846565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.847360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.847640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.847915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.855938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:43.857974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:43.873668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 11:19:43.874977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 604/1210] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:43.881275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.892421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508b3d8-f699-4e76-9b41-ae7f56a6e69f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.897266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.898005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.898358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.898673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.900434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:43.900983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:43.902959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:43.925341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 607/1211] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:43.931690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.941587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1351a-0916-4d61-bc96-2a952879aad1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.946362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.947447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.947740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.948012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:43.956665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:43.958475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:43.968876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 605/1212] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:19:43.975122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:43.985635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09584e-32c6-4a84-858b-74c33eec9cd0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:43.990689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:43.991478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:43.991752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:43.992017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:44.003582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:44.005459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:44.023932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:44.025943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 608/1213] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:44.032294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:44.041962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036dc6-486c-4e48-a4f5-48c32536f553 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:44.047259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:44.047509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:44.047790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:44.048062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:44.048865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:44.049171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:44.050845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:44.064015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 606/1214] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:44.073063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:44.083753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fb35d-ac93-4146-bcbd-d9765dd824c3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:44.088997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:44.089791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:44.090069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:44.090375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:44.097919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:44.099928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:44.114322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:19:44.115582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 609/1215] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:44.125139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:44.135942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93069-e33a-4f37-b4d8-fedbe553a23d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:44.140601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:44.141308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:44.141625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:44.141982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:44.142888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:44.143233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:44.145184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3425a5-634a-414c-b5e9-296f0710f08c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:44.159963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 607/1216] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:44.167081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:44.178031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05669f37-b1b7-4530-ab6c-c9c61ba73a23 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:44.186153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:44.186852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:44.187134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:44.187428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:44.188272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b67735ed66544af696d9274554f3001d) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:44.188582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:44.190494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370bf3ef-49b4-45ec-a9cf-936276c3f1f1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:44.197291 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 610/1217] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:19:44 2022] GET /identity/v3/role_assignments?user.id=b67735ed66544af696d9274554f3001d&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:46.822571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b622a-b365-4ab1-bf39-6d0b3cd88dd1 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:46.823126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b622a-b365-4ab1-bf39-6d0b3cd88dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:46.823126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b622a-b365-4ab1-bf39-6d0b3cd88dd1 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:46.824815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 608/1218] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:19:46.830750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:46.831263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:46.831397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:46.849139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:46.850392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:46.858875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 611/1219] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:46.884998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b622a-b365-4ab1-bf39-6d0b3cd88dd1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:46.897467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b622a-b365-4ab1-bf39-6d0b3cd88dd1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:46.902553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:46.903324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:46.903600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:46.903869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:46.914146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:19:46.921954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:19:46.923213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 609/1220] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:46.929351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:46.938843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1b541-b30e-47dc-a113-7e221141bdf3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:46.943560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:46.944217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:46.944498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:46.944771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:46.945533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:46.945836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:46.947603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:46.956937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 612/1221] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:46.963838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:46.974864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32315a-bef3-454e-abd1-ae8221179c5d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:46.980582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:46.981385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:46.981668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:46.981944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:46.994909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:46.996901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.017313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:47.018595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 610/1222] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:47.028593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.039067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd67cc-f9f7-45a1-a29c-3f128a9505ff admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.045034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.045832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.046196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.049903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.049903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:47.049903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.049903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.063707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 613/1223] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:47.072430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.085216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891abf5-551a-4386-8d4c-7de291cb3fdf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.090841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.091704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.091988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.092262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.101547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.104348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.120417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 11:19:47.121694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 611/1224] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:47.128517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.152620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b4da-85d5-4b76-90d1-8439af2d9286 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.161079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.162302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.162808 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.163295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.164953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:47.166090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.169830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.197120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 614/1225] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:47.206274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.217308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5964c7-c9f8-460f-9b7a-1e7bcb942a8b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.222059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.222963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.223282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.223592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.236116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.238201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.254742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:47.255888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 612/1226] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:47.264201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.272158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fb53a-e392-47a7-a1b8-3c107d1fbc85 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.278259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.279085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.279467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.279864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.280746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:47.281144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.282982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.296551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 615/1227] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:47.305565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.322423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6d8ac-1669-45ea-bfeb-8f554886f1b7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.328859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.329650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.329928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.330198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.344384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.344384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.353246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:19:47.354473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 613/1228] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:47.360598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.371184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ce9e4-9b36-41c0-9012-99f7e11ebb44 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.376006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.376678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.376951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.377225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.378043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:47.378386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.380364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d532-7acb-48f6-96f1-0faf0936c4aa admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.394935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 616/1229] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:47.402459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:47.413772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd62a13-985d-4232-8024-910962acd411 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:47.418874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246778c-ffbb-4619-9326-01286916ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:47.419762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246778c-ffbb-4619-9326-01286916ffc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:47.420033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246778c-ffbb-4619-9326-01286916ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:47.420375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246778c-ffbb-4619-9326-01286916ffc7 admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b67735ed66544af696d9274554f3001d/roles/495e32cf8b81456f96cecf7c94c54965` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:47.436480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246778c-ffbb-4619-9326-01286916ffc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=b67735ed66544af696d9274554f3001d, role_id=495e32cf8b81456f96cecf7c94c54965)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:47.439235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246778c-ffbb-4619-9326-01286916ffc7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:47.501704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 614/1230] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:19:47 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b67735ed66544af696d9274554f3001d/roles/495e32cf8b81456f96cecf7c94c54965 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:19:50.123935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71771de-9d48-4b55-868d-3e0a65138f3e None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.124569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71771de-9d48-4b55-868d-3e0a65138f3e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.124569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71771de-9d48-4b55-868d-3e0a65138f3e None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.126268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 617/1231] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:19:50.132011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.132495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.132584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.151396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:50.152608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:50.212073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 615/1232] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:50.239054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71771de-9d48-4b55-868d-3e0a65138f3e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.252741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71771de-9d48-4b55-868d-3e0a65138f3e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.257187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.257983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.258284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.258561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.269875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:19:50.277226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 11:19:50.278615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 618/1233] 10.222.0.20 () {56 vars in 1123 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:50.285096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.294905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc1800-050b-462b-8700-b4f168a4aec2 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.299479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.300180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.300462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.300737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.301500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] RBAC: Adding query filter params (name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:50.301804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.303495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.313642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 616/1234] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:50.320115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.331203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788286a2-1409-4908-9c7e-c2d47a79ea6b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.336204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.337032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.337321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.337730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.349522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.351445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.371284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:50.372527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 619/1235] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:50.378799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.389209 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758af6e-f0e8-46aa-8d55-61fc27d810ef admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.394235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.397036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.397036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.397036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.397036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:50.397036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.398101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.410693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 617/1236] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:50.417157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.426875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48514c51-7402-40ef-9121-3d117a73df80 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.432166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.432955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.433230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.433493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.441302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.443459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.459423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 11:19:50.460705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 620/1237] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:19:50.466983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.476911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0354-d9ed-4c2e-926e-072d8c48cc39 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.483214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.483214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.483509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.483747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.484601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:50.484903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.486798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.505387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 618/1238] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:50.511896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.521771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c1596-a89c-4e59-b188-05974c5f2d89 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.526387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.527015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.527316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.527584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.535651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.537393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.546642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 621/1239] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:19:50.552377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.562964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84653e85-2e72-4173-89ee-fe4feb490890 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.567777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.568586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.568862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.569208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.579769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.581674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.599105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:50.600284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 619/1240] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:50.606973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.617219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a5bb-6c67-402f-91df-5cf66651f970 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.622395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.623100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.623416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.623727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.624523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:50.624872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.626636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.643664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 622/1241] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:50.644582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.654965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadee257-f35f-4baa-bc05-c92361c1f218 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.659733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.660550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.660952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.661271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.672846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.679850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.689923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:19:50.691178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 620/1242] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:50.697496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.707838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4935-cbe4-400c-8dc4-c1004e028239 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.712564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.713210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.713483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.713753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.714595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:50.714900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.716791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0e0f2-5ec9-49f7-9b46-196f56b38ce9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.731946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 623/1243] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:50.738671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:50.751671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44603225-4952-4aad-be1d-22996a68704a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:50.756370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:50.757004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:50.757288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:50.757567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:50.758441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] RBAC: Adding query filter params (role.id=495e32cf8b81456f96cecf7c94c54965, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b67735ed66544af696d9274554f3001d) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:50.758753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:50.763991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6c0e-f448-4a5d-88a4-44b8d7f7b6b8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:50.768313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 621/1244] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:19:50 2022] GET /identity/v3/role_assignments?user.id=b67735ed66544af696d9274554f3001d&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=495e32cf8b81456f96cecf7c94c54965 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:53.434900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bafcc-fb13-47d9-a69f-78c14cd434c4 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.435543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bafcc-fb13-47d9-a69f-78c14cd434c4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.435543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bafcc-fb13-47d9-a69f-78c14cd434c4 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.437270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 624/1245] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:19:53.445605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.446058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.446404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.473876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:53.475835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:53.486068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 622/1246] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:53.512800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bafcc-fb13-47d9-a69f-78c14cd434c4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.525385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bafcc-fb13-47d9-a69f-78c14cd434c4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.530607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.535175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.535175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.535175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.543456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:19:53.550504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:19:53.551763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 625/1247] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:53.558672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.569177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef107e-d5dc-47c0-85b4-3dad5022a4c0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.574489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.575242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.575517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.575787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.583209 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:53.583520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.585155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.595212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 623/1248] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:53.601263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.612281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203c753-9f3c-49df-8be5-3d83964fc19d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.617130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.617904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.618182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.619198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.630555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.632546 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.652429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:53.665466 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 626/1249] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:19:53.672436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.683602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8de95b-f553-4124-b735-76795b3a757a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.688545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.689271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.689501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.689780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.690563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:53.690870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.692542 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.707300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 624/1250] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:53.714453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.726346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dcfc1-ce1a-4f2b-9446-23b7a2e4692b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.732006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.732984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.733331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.733669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.745030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.747715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.765879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 11:19:53.767134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 627/1251] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:19:53.773165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.783755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d55c3-58a6-4daa-9752-fe1c2fb0bd49 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.788522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.789182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.789464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.789736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.790719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:53.791026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.793079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.813340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 625/1252] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:53.819447 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.830672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce050fe-a2d0-4ad0-8401-57f8c009b910 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.835435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.836083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.836382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.836649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.845682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.847525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.857562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 628/1253] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:19:53.864306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.875531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f696a-f427-45b4-9cbf-3990e6a07223 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.880384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.881246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.881530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.884903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.894787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.896782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.915390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:53.916642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 626/1254] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:53.924079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.934128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025a7eb-f705-4192-a696-16f2ee9754a9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.939300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.939980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.940295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.940603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.941396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:53.941732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.943540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:53.961990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 629/1255] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:53.967404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:53.979225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680989b-c14d-4692-8328-11fd1f3f8556 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:53.984304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:53.985108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:53.985385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:53.985654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:53.995296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:53.997398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:54.012471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:19:54.013928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 627/1256] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:54.019959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:54.030968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e635847-3cad-42e3-96b1-6ab8bae45e0a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:54.036059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:54.036688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:54.036963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:54.037236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:54.038147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:54.038486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:54.041001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6af5d4-217b-48f4-b5e5-95181353b8d2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:54.056751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 630/1257] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:19:54.063152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:54.074941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d016e-b7f6-4d6c-83ed-b97fc8b8fe56 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:54.080575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:54.081684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:54.082269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:54.082776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:54.084292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b67735ed66544af696d9274554f3001d) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:54.084612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:54.086695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2e4c8-7d86-4357-ab85-3d160682bc48 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:54.094162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 628/1258] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:19:54 2022] GET /identity/v3/role_assignments?user.id=b67735ed66544af696d9274554f3001d&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:56.686907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b9a7-e68e-40f3-bf8d-3feffea2a51f None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.687449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b9a7-e68e-40f3-bf8d-3feffea2a51f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.687449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b9a7-e68e-40f3-bf8d-3feffea2a51f None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.689218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 631/1259] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:19:56.694470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b490-f692-4130-846e-57698c296db3 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.694912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b490-f692-4130-846e-57698c296db3 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.695141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b490-f692-4130-846e-57698c296db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.713787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-eca8b490-f692-4130-846e-57698c296db3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:56.715013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-eca8b490-f692-4130-846e-57698c296db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:56.723093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 629/1260] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:56.749893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b9a7-e68e-40f3-bf8d-3feffea2a51f None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:56.763158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b9a7-e68e-40f3-bf8d-3feffea2a51f None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:56.767967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:56.768888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.769209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.769532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.781511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:19:56.788535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:19:56.789774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 632/1261] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:56.796670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b490-f692-4130-846e-57698c296db3 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:56.806188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b490-f692-4130-846e-57698c296db3 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:56.811084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:56.811834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.812114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.812380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.813220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:56.813521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:56.815233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:56.824872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 630/1262] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:56.841382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:56.841788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b8bb-7484-4b97-8e48-10be0cb2c955 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:56.846662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:56.847489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.847767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.848041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.860196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:56.862143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:56.879962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:56.881200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 633/1263] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:56.887248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:56.901619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917f37c-4b52-466e-8955-5337df03c2a7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:56.908989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:56.910050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.910629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.911030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.912436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:56.912948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:56.916797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:56.938417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 631/1264] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:56.944384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:56.954916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf684fc-b88a-4dec-9200-d77f966b4f5e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:56.959573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:56.960363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:56.960637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:56.960902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:56.970326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:56.972356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:56.987081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 11:19:56.988527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 634/1265] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:56.995525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:57.005216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18be0-5d3f-416f-8353-72c4560f6c35 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:57.010096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:57.010781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:57.011062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:57.011336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:57.012188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:57.012494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:57.019825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:57.032358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 632/1266] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Jan 10 11:19:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:57.038629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:57.051500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c7e9-0462-4ac9-9846-f9b88be8d8fe admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:57.057510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:57.058329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:57.058606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:57.058874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:57.071457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:57.073397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:57.091415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:19:57.092704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 635/1267] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 11:19:57.099023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:57.110116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651e45-b10b-46cb-915c-29e899264c6b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:57.115608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:57.116277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:57.116556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:57.116827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:57.117698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:57.118000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:57.120500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:57.132600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 633/1268] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:57.138730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:57.149233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bc0e5-dc3e-41f2-bbe5-201bffd537d7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:57.154609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:57.155428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:57.155705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:57.155972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:57.163306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:57.166058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:57.179801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:19:57.182714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 636/1269] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:19:57.187454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:57.198706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f319-38ee-419a-8571-146766d6bf62 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:57.203313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:57.203996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:57.204269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:57.204543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:57.205337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:19:57.205641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:57.207525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34fdc2-3611-4cb0-952b-3fe4c358f0a4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:57.219878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 634/1270] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:19:57.226147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:57.237048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7241fa-cf71-48ca-bef0-cf55da25e7fa admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:57.241975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b70e6-20b4-4ab6-855d-e2b9dc04682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:57.242881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b70e6-20b4-4ab6-855d-e2b9dc04682b admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:57.249217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b70e6-20b4-4ab6-855d-e2b9dc04682b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:57.249217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b70e6-20b4-4ab6-855d-e2b9dc04682b admin admin] PATH_INFO: `/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b67735ed66544af696d9274554f3001d/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:57.249217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b70e6-20b4-4ab6-855d-e2b9dc04682b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5459e4b2b6463e9e155429f1541f97, user_id=b67735ed66544af696d9274554f3001d, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:19:57.249217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b70e6-20b4-4ab6-855d-e2b9dc04682b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:19:57.355318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 637/1271] 10.222.0.20 () {58 vars in 1460 bytes} [Mon Jan 10 11:19:57 2022] PUT /identity/v3/projects/8c5459e4b2b6463e9e155429f1541f97/users/b67735ed66544af696d9274554f3001d/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:19:59.847878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cf80-e6a5-4e92-b3bf-ea8fc74eeb9b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:59.848384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cf80-e6a5-4e92-b3bf-ea8fc74eeb9b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:59.848384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000cf80-e6a5-4e92-b3bf-ea8fc74eeb9b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:59.850132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 635/1272] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:19:59.856153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:59.856644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:59.856756 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:19:59.875463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:19:59.876685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:19:59.950558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 638/1273] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:19:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:19:59.977472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000cf80-e6a5-4e92-b3bf-ea8fc74eeb9b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:19:59.991009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000cf80-e6a5-4e92-b3bf-ea8fc74eeb9b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:19:59.995697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:19:59.996469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:19:59.996748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:19:59.997018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.007966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 11:20:00.015494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 11:20:00.016723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 636/1274] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Jan 10 11:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:00.022792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.032711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239e4e-4400-4714-a283-cf0699ad93fd None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.037209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.037866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.038352 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.038617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.039375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:00.039676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.041378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.050329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 639/1275] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:00.056411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.067089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa418f-c0f0-4082-ada2-4b8af33b0c26 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.071569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.073081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.073442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.073720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.084363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.089724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.105021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:20:00.106155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 637/1276] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:00.112229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.122511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342ebb1-3677-4627-bc81-7de73802f621 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.127232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.127885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.128168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.128441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.129174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:00.129479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.131182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.144214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 640/1277] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:00.149981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.160701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1bfe4-9ef9-43b0-84a8-5403d5436990 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.165928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.167026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.167306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.167622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.175362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.177317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.193189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 11:20:00.194473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 638/1278] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:00.201389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.212139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315ac4d-e9b8-481d-9186-c3396324ca86 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.221251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.221251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.221251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.221251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.221637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:00.221637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.222423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.241238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 641/1279] 10.222.0.20 () {56 vars in 1164 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:00.247277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.257292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f659-5530-4a55-9e07-e75be363e8d1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.262549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.263257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.263559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.263837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.272150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.274100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.284006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 639/1280] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:20:00.290031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.300058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed70a4-4845-4700-b1c4-fbc44183b2b6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.304794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.305580 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.305856 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.306122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.317471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.319500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.337832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 11:20:00.339128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 642/1281] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:00.345069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.354702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c28a5-6e90-42f4-a1cb-a3ab877e344a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.359513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.360104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.360389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.360667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.361403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:00.361709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.363334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.376149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 640/1282] 10.222.0.20 () {56 vars in 1130 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:00.381877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.392545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf128-5321-4d5f-b8be-939154b465e7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.396987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.397766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.398044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.398446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.405341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.407346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.420257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING keystone.server.flask.application [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 11:20:00.421551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 643/1283] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:00.428522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.439102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf472e5c-4040-49c5-bae2-7a23645e8d87 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.443800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.444451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.444736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.445011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.445815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:00.446120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.448625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98a9c-18f0-4025-9fc5-812623e86a85 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.461113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 641/1284] 10.222.0.20 () {56 vars in 1169 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:00.468671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:00.479567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce0ab2-78fc-41f6-9ec7-88b6e31d65a3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:00.484290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:00.484941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:00.485222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:00.485494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:00.486390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] RBAC: Adding query filter params (role.id=cb161f7cc15b46b884b56cf0c9cf0367, scope.project.id=8c5459e4b2b6463e9e155429f1541f97, user.id=b67735ed66544af696d9274554f3001d) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:00.486685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:00.488854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb74d72-5b7d-481b-84b7-f77ef3c50005 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:00.496073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 644/1285] 10.222.0.20 () {56 vars in 1395 bytes} [Mon Jan 10 11:20:00 2022] GET /identity/v3/role_assignments?user.id=b67735ed66544af696d9274554f3001d&scope.project.id=8c5459e4b2b6463e9e155429f1541f97&role.id=cb161f7cc15b46b884b56cf0c9cf0367 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:03.054597 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfca69a-caea-4a2b-813d-e46a5021d3d4 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:03.055203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfca69a-caea-4a2b-813d-e46a5021d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:03.055203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfca69a-caea-4a2b-813d-e46a5021d3d4 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:03.056920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 642/1286] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:20:03.063424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:03.063857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:03.063971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:03.082002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:20:03.083264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:20:03.091791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 645/1287] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:20:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:20:03.114348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfca69a-caea-4a2b-813d-e46a5021d3d4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:03.126792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfca69a-caea-4a2b-813d-e46a5021d3d4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:03.131186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:03.131952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:03.132228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:03.132496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:03.133158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:03.135348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:03.146274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 11:20:03.147465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 643/1288] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:20:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:03.154758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:03.163835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee534b-d514-4798-adc0-eacb41f54b44 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:03.168407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:03.169046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:03.169333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:03.169612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:03.170383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:03.170684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:03.172290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b042608-6fd1-4a0c-96e4-bb33db0734d0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:03.177424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 646/1289] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jan 10 11:20:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:20:03.189150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:03.199980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cedc65-1ea9-483b-b1b1-d514f7375c95 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:03.204502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:03.205145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:03.205429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:03.205705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] PATH_INFO: `/v3/services` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:03.206461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:03.206770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:03.208371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86111d-0506-4c37-8261-c88fd1952b52 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:03.213930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 644/1290] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jan 10 11:20:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:05.646201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ce27-cc6d-49cf-87bb-caba72430aca None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:05.646785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ce27-cc6d-49cf-87bb-caba72430aca None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:05.646785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3ce27-cc6d-49cf-87bb-caba72430aca None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:05.648496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 647/1291] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:20:05.654233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b1cd-4cf4-4d38-bd74-99648d440e20 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:05.656715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b1cd-4cf4-4d38-bd74-99648d440e20 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:05.656715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4b1cd-4cf4-4d38-bd74-99648d440e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:05.673558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6bf4b1cd-4cf4-4d38-bd74-99648d440e20 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:20:05.674808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6bf4b1cd-4cf4-4d38-bd74-99648d440e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:20:05.682637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 645/1292] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:20:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:20:05.707338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3ce27-cc6d-49cf-87bb-caba72430aca None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:05.719981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3ce27-cc6d-49cf-87bb-caba72430aca None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:05.724733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c346012-c8f7-43f0-b9a7-4decea137680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:05.725378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346012-c8f7-43f0-b9a7-4decea137680 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:05.725661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346012-c8f7-43f0-b9a7-4decea137680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:05.725935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c346012-c8f7-43f0-b9a7-4decea137680 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:05.726701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346012-c8f7-43f0-b9a7-4decea137680 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:05.728448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c346012-c8f7-43f0-b9a7-4decea137680 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:05.846863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 648/1293] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Jan 10 11:20:05 2022] POST /identity/v3/services => generated 246 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:20:08.306983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3d51b-e91f-4183-bb23-3b29da4ce4af None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:08.307554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3d51b-e91f-4183-bb23-3b29da4ce4af None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:08.307658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3d51b-e91f-4183-bb23-3b29da4ce4af None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:08.309462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 646/1294] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:20:08.314724 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:08.317290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:08.317290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:08.335585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:20:08.336729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:20:08.354522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 649/1295] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:20:08.379958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3d51b-e91f-4183-bb23-3b29da4ce4af None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:08.395617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3d51b-e91f-4183-bb23-3b29da4ce4af None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:08.401046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:08.401981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:08.402286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:08.402557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:08.403216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:08.404824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:08.415637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 11:20:08.417461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 647/1296] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:20:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:08.423508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:08.433091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7ab19-c036-4270-95af-83e1574fc429 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:08.437677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:08.438354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:08.438634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:08.438908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:08.439610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:08.439912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:08.441505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:08.446627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 650/1297] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jan 10 11:20:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:08.452523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:08.461984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9555c60-b1aa-422a-b05a-6b7015926f49 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:08.467862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:08.468488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:08.468765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:08.469035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:08.469829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] RBAC: Adding query filter params (interface=public, service_id=f010cc3188ab49cba43a111038452dfc, region_id=RegionOne) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:08.470135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:08.471742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce590ef8-3137-47bc-8e34-bb6a37476a84 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:08.476737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 648/1298] 10.222.0.20 () {56 vars in 1272 bytes} [Mon Jan 10 11:20:08 2022] GET /identity/v3/endpoints?service_id=f010cc3188ab49cba43a111038452dfc&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:08.483310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:08.495768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034653c-0a40-4f44-b878-79c1f96f45fe admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:08.500325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c04b7d-56ab-4b43-997b-0b3df56f34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:08.500974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c04b7d-56ab-4b43-997b-0b3df56f34d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:08.501259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c04b7d-56ab-4b43-997b-0b3df56f34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:08.501531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c04b7d-56ab-4b43-997b-0b3df56f34d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:08.502240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c04b7d-56ab-4b43-997b-0b3df56f34d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:08.503850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c04b7d-56ab-4b43-997b-0b3df56f34d2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:08.510958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 651/1299] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:20:08 2022] GET /identity/v3/services => generated 2191 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:20:10.987935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb86701-1dd9-4369-805d-7bd64c8ecd37 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:10.988503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb86701-1dd9-4369-805d-7bd64c8ecd37 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:10.988503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb86701-1dd9-4369-805d-7bd64c8ecd37 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:10.990567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 649/1300] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:20:10.996062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:10.996555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:10.996657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:11.014634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:20:11.015833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:20:11.023649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 652/1301] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:20:11.049332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb86701-1dd9-4369-805d-7bd64c8ecd37 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:11.062012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb86701-1dd9-4369-805d-7bd64c8ecd37 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:11.066446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:11.067226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:11.067505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:11.067822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:11.068488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:11.070081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:11.081608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING keystone.server.flask.application [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 11:20:11.082816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 650/1302] 10.222.0.20 () {56 vars in 1138 bytes} [Mon Jan 10 11:20:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 11:20:11.089429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:11.098500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6020764-f910-47f2-a644-d0855113f2ee None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:11.103136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:11.104385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:11.104670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:11.104940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] PATH_INFO: `/v3/services` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:11.105666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:20:11.105963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:11.107617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38789023-e4a2-4f2d-905e-060797d5d17b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:11.113168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 653/1303] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Jan 10 11:20:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:20:11.119312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:20:11.130367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fe162-d1b4-4ab0-b988-5371e9966a27 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:20:11.134848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299fce-01ac-42f8-b7fe-ab256eb44e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:20:11.135623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299fce-01ac-42f8-b7fe-ab256eb44e53 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:20:11.135897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299fce-01ac-42f8-b7fe-ab256eb44e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:20:11.136166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299fce-01ac-42f8-b7fe-ab256eb44e53 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:20:11.136915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299fce-01ac-42f8-b7fe-ab256eb44e53 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:20:11.138533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299fce-01ac-42f8-b7fe-ab256eb44e53 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:20:11.241707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 651/1304] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Jan 10 11:20:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:28:57.503114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f05de-b91b-4697-ad2a-e8961011d7d0 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:28:57.503997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f05de-b91b-4697-ad2a-e8961011d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:28:57.504434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f05de-b91b-4697-ad2a-e8961011d7d0 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:28:57.507245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 654/1305] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:28:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:28:57.514790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92532-c19e-4449-be37-3ef855a00b17 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:28:57.515648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92532-c19e-4449-be37-3ef855a00b17 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:28:57.516090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92532-c19e-4449-be37-3ef855a00b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:28:57.647072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6dc92532-c19e-4449-be37-3ef855a00b17 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:28:57.651263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6dc92532-c19e-4449-be37-3ef855a00b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:28:57.886322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 652/1306] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:28:57.900410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f05de-b91b-4697-ad2a-e8961011d7d0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:28:57.903289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3c4f05de-b91b-4697-ad2a-e8961011d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:28:58.066761 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f05de-b91b-4697-ad2a-e8961011d7d0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:28:58.171899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bec4ef-42fd-494a-b845-c6a4a2db737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:28:58.173097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec4ef-42fd-494a-b845-c6a4a2db737c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:28:58.173693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec4ef-42fd-494a-b845-c6a4a2db737c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:28:58.174364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bec4ef-42fd-494a-b845-c6a4a2db737c admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:28:58.175518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bec4ef-42fd-494a-b845-c6a4a2db737c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:28:58.178437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bec4ef-42fd-494a-b845-c6a4a2db737c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:28:58.214646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 655/1307] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:28:57 2022] GET /identity/v3/projects => generated 2553 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:29:00.838340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658a992-aaa1-4e71-92dc-7463263c5b2a None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:00.838779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658a992-aaa1-4e71-92dc-7463263c5b2a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:00.838900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658a992-aaa1-4e71-92dc-7463263c5b2a None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:00.840676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 653/1308] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:00.849162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258b89c-48fd-47ec-93ce-c92424875118 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:00.849653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258b89c-48fd-47ec-93ce-c92424875118 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:00.849741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258b89c-48fd-47ec-93ce-c92424875118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:00.937940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5258b89c-48fd-47ec-93ce-c92424875118 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:00.940784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5258b89c-48fd-47ec-93ce-c92424875118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:01.039917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 656/1309] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:01.063423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658a992-aaa1-4e71-92dc-7463263c5b2a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:01.064959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d658a992-aaa1-4e71-92dc-7463263c5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:01.187889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658a992-aaa1-4e71-92dc-7463263c5b2a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:01.282501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e36b0-f6b5-471b-8c62-e8da098d01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:01.283151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e36b0-f6b5-471b-8c62-e8da098d01e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:01.283428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e36b0-f6b5-471b-8c62-e8da098d01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:01.283703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e36b0-f6b5-471b-8c62-e8da098d01e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:01.284447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e36b0-f6b5-471b-8c62-e8da098d01e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:01.286358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e36b0-f6b5-471b-8c62-e8da098d01e9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:01.309313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 654/1310] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:29:01 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:29:03.784371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04896849-c7d2-44e1-968d-b6d6bb03eb6f None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:03.784902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04896849-c7d2-44e1-968d-b6d6bb03eb6f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:03.784902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04896849-c7d2-44e1-968d-b6d6bb03eb6f None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:03.786706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 657/1311] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:03.792123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f9ff-f2dc-48b2-86a1-e74b33b9d323 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:03.792607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f9ff-f2dc-48b2-86a1-e74b33b9d323 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:03.792703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01f9ff-f2dc-48b2-86a1-e74b33b9d323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:03.976833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6a01f9ff-f2dc-48b2-86a1-e74b33b9d323 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:03.978689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6a01f9ff-f2dc-48b2-86a1-e74b33b9d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:04.073571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 655/1312] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:04.124429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae479-ef4f-4b27-941c-c967d93300b1 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:04.124714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae479-ef4f-4b27-941c-c967d93300b1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:04.124992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae479-ef4f-4b27-941c-c967d93300b1 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:04.126780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 658/1313] 10.222.0.20 () {54 vars in 964 bytes} [Mon Jan 10 11:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:04.132804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2220-3bf1-4cf2-9ad1-f6ef69b77aca None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:04.133093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2220-3bf1-4cf2-9ad1-f6ef69b77aca None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:04.133860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2220-3bf1-4cf2-9ad1-f6ef69b77aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:04.205767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-00ac2220-3bf1-4cf2-9ad1-f6ef69b77aca None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:04.206997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-00ac2220-3bf1-4cf2-9ad1-f6ef69b77aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:04.279967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 656/1314] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Jan 10 11:29:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:04.289060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cae479-ef4f-4b27-941c-c967d93300b1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:04.291337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a1cae479-ef4f-4b27-941c-c967d93300b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:04.506905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cae479-ef4f-4b27-941c-c967d93300b1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:04.576706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:04.577337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:04.577614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:04.577885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:04.579520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:04.684463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:04.685899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d5c1-e56d-4a9f-b7d9-88a83d6fe916 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:04.703556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 659/1315] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:07.408258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f486de-c50c-4cab-b4d0-36b20b38c339 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:07.408794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f486de-c50c-4cab-b4d0-36b20b38c339 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:07.408794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f486de-c50c-4cab-b4d0-36b20b38c339 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:07.410644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 657/1316] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:07.417452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:07.417880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:07.417991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:07.479218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:07.480400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:07.571562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 660/1317] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:07.608018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f486de-c50c-4cab-b4d0-36b20b38c339 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:07.609596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-76f486de-c50c-4cab-b4d0-36b20b38c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:07.735654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f486de-c50c-4cab-b4d0-36b20b38c339 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:07.827660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110cf9c-0ffe-4ef9-b096-0938bc51a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:07.828497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110cf9c-0ffe-4ef9-b096-0938bc51a773 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:07.828798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110cf9c-0ffe-4ef9-b096-0938bc51a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:07.829048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110cf9c-0ffe-4ef9-b096-0938bc51a773 admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:07.829959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110cf9c-0ffe-4ef9-b096-0938bc51a773 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:07.831785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110cf9c-0ffe-4ef9-b096-0938bc51a773 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:07.833457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 658/1318] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:29:07 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:29:07.845534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:07.846764 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:07.937349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad4efc-5eec-4802-bdda-e0dbe26ef8f1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:08.008310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:08.009505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:08.009809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:08.010081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:08.011745 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:08.117203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:08.119210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b457c-0bc0-4505-8df1-60b8170cb1dc service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:08.137500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 661/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:11.178390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283b350-6464-46c2-81ec-ed3628cde723 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:11.178999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283b350-6464-46c2-81ec-ed3628cde723 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:11.178999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283b350-6464-46c2-81ec-ed3628cde723 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:11.180953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 659/1320] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:11.186155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:11.186631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:11.186723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:11.249857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:11.251078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:11.347742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 662/1321] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:11.384623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283b350-6464-46c2-81ec-ed3628cde723 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:11.386128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b283b350-6464-46c2-81ec-ed3628cde723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:11.505576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283b350-6464-46c2-81ec-ed3628cde723 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:11.595599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87b00a-b196-43d1-89db-3b20c58652dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:11.596434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b00a-b196-43d1-89db-3b20c58652dc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:11.596711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b00a-b196-43d1-89db-3b20c58652dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:11.596983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b00a-b196-43d1-89db-3b20c58652dc admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:11.607108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87b00a-b196-43d1-89db-3b20c58652dc admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:11.609170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87b00a-b196-43d1-89db-3b20c58652dc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:11.610907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 660/1322] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:29:11 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:29:11.623784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:11.624976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:11.717733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a41bb-2268-470f-aa73-ca209cb2f996 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:11.788504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:11.789048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:11.789322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:11.789588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:11.791818 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:11.897716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:11.899717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82a58f-336d-4e67-b255-bcd8850b6406 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:11.918065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 663/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:15.330703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a69fc-17f2-4221-946c-8b9d9cd0f584 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:15.331345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a69fc-17f2-4221-946c-8b9d9cd0f584 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:15.331345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a69fc-17f2-4221-946c-8b9d9cd0f584 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:15.333043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 661/1324] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:15.338859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:15.339306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:15.339407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:15.402684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:15.403885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:15.497860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 664/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:15.533768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a69fc-17f2-4221-946c-8b9d9cd0f584 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:15.535303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-838a69fc-17f2-4221-946c-8b9d9cd0f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:15.654749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a69fc-17f2-4221-946c-8b9d9cd0f584 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:15.744095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416ea8-64ca-4b6b-80c5-fff07fe2909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:15.744920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416ea8-64ca-4b6b-80c5-fff07fe2909b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:15.745196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416ea8-64ca-4b6b-80c5-fff07fe2909b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:15.745467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416ea8-64ca-4b6b-80c5-fff07fe2909b admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:15.755688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce416ea8-64ca-4b6b-80c5-fff07fe2909b admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:15.757781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce416ea8-64ca-4b6b-80c5-fff07fe2909b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:15.760264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 662/1326] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:29:15 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:29:15.771770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:15.772989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:15.857859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0966784-3e88-4b2d-b686-f7b555c68d0c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:15.928033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:15.928589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:15.928864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:15.929133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:15.931405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:16.035495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:16.036926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02921306-b084-4953-9804-8b89715745c7 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:16.056684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 665/1327] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:19.779683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77231b07-b6cf-4035-be89-f935bcd6c2e2 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:19.780253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77231b07-b6cf-4035-be89-f935bcd6c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:19.780253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77231b07-b6cf-4035-be89-f935bcd6c2e2 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:19.781985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 663/1328] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:19.787131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cea8c-4d47-4b03-bf38-c3be9fe08850 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:19.787550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cea8c-4d47-4b03-bf38-c3be9fe08850 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:19.787912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cea8c-4d47-4b03-bf38-c3be9fe08850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:19.852263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e61cea8c-4d47-4b03-bf38-c3be9fe08850 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:19.853454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e61cea8c-4d47-4b03-bf38-c3be9fe08850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:19.949412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 666/1329] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:20.004779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c91d7-30d0-40c1-afd3-e64ab9584557 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:20.005074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c91d7-30d0-40c1-afd3-e64ab9584557 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:20.005348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c91d7-30d0-40c1-afd3-e64ab9584557 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:20.007207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 664/1330] 10.222.0.20 () {54 vars in 964 bytes} [Mon Jan 10 11:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:20.017466 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b15f-8ea9-44c7-b71e-38a860ccac15 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:20.017819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b15f-8ea9-44c7-b71e-38a860ccac15 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:20.018093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b15f-8ea9-44c7-b71e-38a860ccac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:20.095207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-28f9b15f-8ea9-44c7-b71e-38a860ccac15 None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:20.096331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-28f9b15f-8ea9-44c7-b71e-38a860ccac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:20.172237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 667/1331] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Jan 10 11:29:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:20.181161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c91d7-30d0-40c1-afd3-e64ab9584557 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:20.182706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-984c91d7-30d0-40c1-afd3-e64ab9584557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:20.281838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c91d7-30d0-40c1-afd3-e64ab9584557 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:20.361426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:20.362000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:20.362309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:20.362587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:20.364272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:20.484239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:20.485708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02258889-b90c-4888-825e-25688fbe1c6f service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:20.506060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 665/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:23.227660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa173c-bf73-466b-aea1-89425becc340 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:23.228236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa173c-bf73-466b-aea1-89425becc340 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:23.228348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa173c-bf73-466b-aea1-89425becc340 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:23.230145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 668/1333] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:23.235347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6d0ec-f0d5-4d89-83f6-d9bdf1c3cc22 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:23.235752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6d0ec-f0d5-4d89-83f6-d9bdf1c3cc22 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:23.235917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6d0ec-f0d5-4d89-83f6-d9bdf1c3cc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:23.299626 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b0b6d0ec-f0d5-4d89-83f6-d9bdf1c3cc22 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:23.300810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b0b6d0ec-f0d5-4d89-83f6-d9bdf1c3cc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:23.397431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 666/1334] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:23.436883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa173c-bf73-466b-aea1-89425becc340 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:23.438665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c6fa173c-bf73-466b-aea1-89425becc340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:23.556957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa173c-bf73-466b-aea1-89425becc340 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:23.629996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:23.630694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:23.630977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:23.631246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:23.633024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:23.742770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:23.744229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5a7e1-5083-4d13-9398-b33e554e457a service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:23.765246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 669/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:26.272909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8741f-990f-42cf-89e5-4909193d9568 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:26.273585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8741f-990f-42cf-89e5-4909193d9568 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:26.273585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8741f-990f-42cf-89e5-4909193d9568 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:26.275240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 667/1336] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:29:26.280384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:26.280793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:26.280925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:26.345686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:26.346970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:26.457362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 670/1337] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:26.492885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8741f-990f-42cf-89e5-4909193d9568 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:26.494455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e0c8741f-990f-42cf-89e5-4909193d9568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:26.636627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8741f-990f-42cf-89e5-4909193d9568 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:26.733489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65260754-4156-4cec-b5ff-482c48ec0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:26.734391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65260754-4156-4cec-b5ff-482c48ec0681 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:26.734671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65260754-4156-4cec-b5ff-482c48ec0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:26.734944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65260754-4156-4cec-b5ff-482c48ec0681 admin admin] PATH_INFO: `/v3/projects/c3bf921f7c464742a0bf047e27abb27e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:26.746631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65260754-4156-4cec-b5ff-482c48ec0681 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3bf921f7c464742a0bf047e27abb27e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:26.748817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65260754-4156-4cec-b5ff-482c48ec0681 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:26.756986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 668/1338] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:29:26 2022] GET /identity/v3/projects/c3bf921f7c464742a0bf047e27abb27e => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:29:26.766398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:26.766398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:26.861634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5a593-c78c-4bbb-b123-76ec0301ba55 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:26.939960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:26.940609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:26.940887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:26.941159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:26.942812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:27.051606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:27.053050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff3246-f1e7-4f9d-9808-1e3b7ab94e16 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:27.070718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 671/1339] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:30.248346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a9ab9-5ea6-473b-bb53-24d9847cfa22 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:30.248954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a9ab9-5ea6-473b-bb53-24d9847cfa22 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:30.248954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a9ab9-5ea6-473b-bb53-24d9847cfa22 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:30.250682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 669/1340] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:30.255721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf719-2459-44b7-82ef-0179864d00ca None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:30.256140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf719-2459-44b7-82ef-0179864d00ca None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:30.256371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cf719-2459-44b7-82ef-0179864d00ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:30.328365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-515cf719-2459-44b7-82ef-0179864d00ca None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:30.329567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-515cf719-2459-44b7-82ef-0179864d00ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:30.431294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 672/1341] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:30.467878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a9ab9-5ea6-473b-bb53-24d9847cfa22 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:30.469968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6e8a9ab9-5ea6-473b-bb53-24d9847cfa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:30.564634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a9ab9-5ea6-473b-bb53-24d9847cfa22 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:30.568120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3741-d0f9-4dc4-ad19-f1ffb7b02ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:30.568790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3741-d0f9-4dc4-ad19-f1ffb7b02ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:30.569140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3741-d0f9-4dc4-ad19-f1ffb7b02ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:30.569342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3741-d0f9-4dc4-ad19-f1ffb7b02ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:30.578123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3741-d0f9-4dc4-ad19-f1ffb7b02ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:30.579649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3741-d0f9-4dc4-ad19-f1ffb7b02ae2 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:30.589815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 670/1342] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:33.200272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f118b-5b40-4a2d-8194-b7a00f00c30a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:33.200844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f118b-5b40-4a2d-8194-b7a00f00c30a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:33.200844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f118b-5b40-4a2d-8194-b7a00f00c30a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:33.202613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 673/1343] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:33.207846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:33.208230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:33.208395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:33.226800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:33.227974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:33.236143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 671/1344] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:33.275377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f118b-5b40-4a2d-8194-b7a00f00c30a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:33.288206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f118b-5b40-4a2d-8194-b7a00f00c30a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:33.292687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714b631-6f20-4766-aaa4-dcca91ec9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:33.293517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714b631-6f20-4766-aaa4-dcca91ec9aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:33.293797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714b631-6f20-4766-aaa4-dcca91ec9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:33.294072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714b631-6f20-4766-aaa4-dcca91ec9aeb admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:33.295302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714b631-6f20-4766-aaa4-dcca91ec9aeb admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:33.297101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714b631-6f20-4766-aaa4-dcca91ec9aeb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:33.298761 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 674/1345] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:29:33 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:29:33.310477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:33.320326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56760fd8-7a46-4a90-ad75-9fd31e97be0a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:33.323873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c954d-eecc-4186-ab53-315b5e2e77cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:33.324480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c954d-eecc-4186-ab53-315b5e2e77cd service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:33.324758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c954d-eecc-4186-ab53-315b5e2e77cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:33.325027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c954d-eecc-4186-ab53-315b5e2e77cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:33.333801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c954d-eecc-4186-ab53-315b5e2e77cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:33.335773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c954d-eecc-4186-ab53-315b5e2e77cd service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:33.344942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 672/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:36.444867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c1a5-b938-40c3-a6dc-e3993430aa34 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:36.445439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c1a5-b938-40c3-a6dc-e3993430aa34 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:36.445546 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c1a5-b938-40c3-a6dc-e3993430aa34 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:36.447316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 675/1347] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:36.452576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d131-d0c0-40ae-8eba-9cdc6de8a246 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:36.452999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d131-d0c0-40ae-8eba-9cdc6de8a246 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:36.453103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851d131-d0c0-40ae-8eba-9cdc6de8a246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:36.470770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8851d131-d0c0-40ae-8eba-9cdc6de8a246 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:36.471935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8851d131-d0c0-40ae-8eba-9cdc6de8a246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:36.479567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 673/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:36.517546 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c1a5-b938-40c3-a6dc-e3993430aa34 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:36.528584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c1a5-b938-40c3-a6dc-e3993430aa34 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:36.532090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411128b-0aae-4a80-ac62-8669e189264e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:36.532710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411128b-0aae-4a80-ac62-8669e189264e service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:36.532987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411128b-0aae-4a80-ac62-8669e189264e service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:36.533256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411128b-0aae-4a80-ac62-8669e189264e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:36.542063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411128b-0aae-4a80-ac62-8669e189264e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:36.543535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411128b-0aae-4a80-ac62-8669e189264e service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:36.553495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 676/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:41.301463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061eb3-ee89-4b49-a8c7-6bfcb9eecded None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:41.302024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061eb3-ee89-4b49-a8c7-6bfcb9eecded None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:41.302024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49061eb3-ee89-4b49-a8c7-6bfcb9eecded None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:41.303950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 674/1350] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:41.310728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ace19-f665-47f2-823f-78eb848e30b9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:41.311145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ace19-f665-47f2-823f-78eb848e30b9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:41.311278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ace19-f665-47f2-823f-78eb848e30b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:41.328840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4e3ace19-f665-47f2-823f-78eb848e30b9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:41.330053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4e3ace19-f665-47f2-823f-78eb848e30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:41.338398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 677/1351] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:41.361832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49061eb3-ee89-4b49-a8c7-6bfcb9eecded None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:41.374478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49061eb3-ee89-4b49-a8c7-6bfcb9eecded None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:41.379070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f5cb3-6d09-4def-862e-36c684292e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:41.379876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5cb3-6d09-4def-862e-36c684292e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:41.380107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5cb3-6d09-4def-862e-36c684292e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:41.380648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5cb3-6d09-4def-862e-36c684292e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:41.381429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f5cb3-6d09-4def-862e-36c684292e09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:41.383335 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f5cb3-6d09-4def-862e-36c684292e09 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:41.398275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 675/1352] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:29:41 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:29:43.958265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea96f3-9494-472e-b45c-2536c07fbe8c None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:43.958794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea96f3-9494-472e-b45c-2536c07fbe8c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:43.958794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea96f3-9494-472e-b45c-2536c07fbe8c None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:43.960599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 678/1353] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:43.965806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:43.966196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:43.966407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:43.983936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:43.985112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:43.993662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 676/1354] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:44.028286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea96f3-9494-472e-b45c-2536c07fbe8c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:44.041387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea96f3-9494-472e-b45c-2536c07fbe8c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:44.045865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77663f6b-b41c-4fb3-94ed-b63e73dc0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:44.046720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77663f6b-b41c-4fb3-94ed-b63e73dc0b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:44.047105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77663f6b-b41c-4fb3-94ed-b63e73dc0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:44.047463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77663f6b-b41c-4fb3-94ed-b63e73dc0b8e admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:44.048671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77663f6b-b41c-4fb3-94ed-b63e73dc0b8e admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:44.050503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77663f6b-b41c-4fb3-94ed-b63e73dc0b8e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:44.052803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 679/1355] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:29:44 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:29:44.065616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:44.066387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:44.078116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359dbc0-5228-49aa-9c55-38ad53812a51 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:44.081809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb105e-489a-46cb-b3c7-2a1749536be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:44.083284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb105e-489a-46cb-b3c7-2a1749536be1 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:44.083564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb105e-489a-46cb-b3c7-2a1749536be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:44.083835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb105e-489a-46cb-b3c7-2a1749536be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:44.092719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb105e-489a-46cb-b3c7-2a1749536be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:44.094144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb105e-489a-46cb-b3c7-2a1749536be1 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:44.104113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 677/1356] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:29:48.027914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116149-a0bb-4e84-9fa8-cd10f0128f07 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:48.033099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116149-a0bb-4e84-9fa8-cd10f0128f07 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:48.033099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91116149-a0bb-4e84-9fa8-cd10f0128f07 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:48.033099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 680/1357] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:48.035537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2fbd-137f-46ec-9b74-4091b33ebbf2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:48.036009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2fbd-137f-46ec-9b74-4091b33ebbf2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:48.036115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe2fbd-137f-46ec-9b74-4091b33ebbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:48.053997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-49fe2fbd-137f-46ec-9b74-4091b33ebbf2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:48.055205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-49fe2fbd-137f-46ec-9b74-4091b33ebbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:48.062941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 678/1358] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:29:48.103136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116149-a0bb-4e84-9fa8-cd10f0128f07 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:48.114058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91116149-a0bb-4e84-9fa8-cd10f0128f07 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:48.117512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec83e0-1b0d-4852-812b-37bc0cc590fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:48.118416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec83e0-1b0d-4852-812b-37bc0cc590fa service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:48.118700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec83e0-1b0d-4852-812b-37bc0cc590fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:48.118975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec83e0-1b0d-4852-812b-37bc0cc590fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:48.127755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec83e0-1b0d-4852-812b-37bc0cc590fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:48.132294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec83e0-1b0d-4852-812b-37bc0cc590fa service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:48.139475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 681/1359] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:52.952747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b47026-d959-4eb7-89f2-e993c0ad19f9 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:52.953285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b47026-d959-4eb7-89f2-e993c0ad19f9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:52.953415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b47026-d959-4eb7-89f2-e993c0ad19f9 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:52.955187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 679/1360] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:52.962629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f054064-0752-4df6-bc27-017ee65cf7d5 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:52.963236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f054064-0752-4df6-bc27-017ee65cf7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:52.963236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f054064-0752-4df6-bc27-017ee65cf7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:52.981081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0f054064-0752-4df6-bc27-017ee65cf7d5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:52.982350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0f054064-0752-4df6-bc27-017ee65cf7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:52.992396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 682/1361] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:29:53.031946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b47026-d959-4eb7-89f2-e993c0ad19f9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:29:53.043444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b47026-d959-4eb7-89f2-e993c0ad19f9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:29:53.047006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873462d-6a93-4529-9f2c-8a3a29d381f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:29:53.047637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873462d-6a93-4529-9f2c-8a3a29d381f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:53.047919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873462d-6a93-4529-9f2c-8a3a29d381f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:53.048194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873462d-6a93-4529-9f2c-8a3a29d381f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:53.058286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873462d-6a93-4529-9f2c-8a3a29d381f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:29:53.059774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873462d-6a93-4529-9f2c-8a3a29d381f7 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:29:53.070692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 680/1362] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:29:58.211673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae7f99-f4f2-4fcb-8f0e-9aad2ed09e29 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:58.212187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae7f99-f4f2-4fcb-8f0e-9aad2ed09e29 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:58.212369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae7f99-f4f2-4fcb-8f0e-9aad2ed09e29 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:58.218664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 683/1363] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:29:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:29:58.226132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52776-a61a-4dc4-a6a6-eb608abf9a56 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:29:58.226595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52776-a61a-4dc4-a6a6-eb608abf9a56 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:29:58.226801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52776-a61a-4dc4-a6a6-eb608abf9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:29:58.311600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3eb52776-a61a-4dc4-a6a6-eb608abf9a56 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:29:58.313036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3eb52776-a61a-4dc4-a6a6-eb608abf9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:29:58.413221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 681/1364] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:29:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:02.980371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcb257-1921-4b40-a91e-aae89226305a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:02.980873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcb257-1921-4b40-a91e-aae89226305a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:02.980873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcb257-1921-4b40-a91e-aae89226305a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:02.982646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 684/1365] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:02.988630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18ae3-9147-4284-a744-744a49073234 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:02.989135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18ae3-9147-4284-a744-744a49073234 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:02.989231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18ae3-9147-4284-a744-744a49073234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:03.008420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-00f18ae3-9147-4284-a744-744a49073234 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:03.009621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-00f18ae3-9147-4284-a744-744a49073234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:03.018506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 682/1366] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:30:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:30:04.550917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc489b07-2c06-4212-991f-ee4463145dba None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:04.551450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc489b07-2c06-4212-991f-ee4463145dba None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:04.551450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc489b07-2c06-4212-991f-ee4463145dba None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:04.553209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 685/1367] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:04.558147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b934a-5740-44b5-9faf-05454c91bc02 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:04.558600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b934a-5740-44b5-9faf-05454c91bc02 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:04.558729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b934a-5740-44b5-9faf-05454c91bc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:04.577252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-068b934a-5740-44b5-9faf-05454c91bc02 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:04.578447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-068b934a-5740-44b5-9faf-05454c91bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:04.587547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 683/1368] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:08.541747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470f21f-815d-41e4-b311-8c8e4529e205 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:08.542459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470f21f-815d-41e4-b311-8c8e4529e205 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:08.542459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470f21f-815d-41e4-b311-8c8e4529e205 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:08.544219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 686/1369] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:08.550932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9fc8-9ef6-453e-9ed0-562bdf1bdb7d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:08.551373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9fc8-9ef6-453e-9ed0-562bdf1bdb7d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:08.551465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9fc8-9ef6-453e-9ed0-562bdf1bdb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:08.570929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6d6b9fc8-9ef6-453e-9ed0-562bdf1bdb7d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:08.572101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6d6b9fc8-9ef6-453e-9ed0-562bdf1bdb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:08.582548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 684/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:08.630614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aeaf7-3a38-4959-9e79-686891ecf3e7 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:08.631172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aeaf7-3a38-4959-9e79-686891ecf3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:08.631631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aeaf7-3a38-4959-9e79-686891ecf3e7 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:08.634064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 687/1371] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jan 10 11:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:08.640826 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0e92-5d16-4a54-8383-bbaf9eb5b5d6 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:08.641292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0e92-5d16-4a54-8383-bbaf9eb5b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:08.642293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a0e92-5d16-4a54-8383-bbaf9eb5b5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:08.696781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c69a0e92-5d16-4a54-8383-bbaf9eb5b5d6 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:08.698100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c69a0e92-5d16-4a54-8383-bbaf9eb5b5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:08.803564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 685/1372] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jan 10 11:30:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:08.815631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aeaf7-3a38-4959-9e79-686891ecf3e7 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:08.830679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aeaf7-3a38-4959-9e79-686891ecf3e7 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:08.836559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191d9df-bf8e-4407-b6b1-4abf1a48de71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:08.837409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d9df-bf8e-4407-b6b1-4abf1a48de71 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:08.837889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d9df-bf8e-4407-b6b1-4abf1a48de71 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:08.838374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d9df-bf8e-4407-b6b1-4abf1a48de71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:08.847907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191d9df-bf8e-4407-b6b1-4abf1a48de71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:08.849791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191d9df-bf8e-4407-b6b1-4abf1a48de71 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:08.861966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 688/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:11.568788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acba861-d0f3-4bf8-9d0a-a073a421c569 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:11.569392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acba861-d0f3-4bf8-9d0a-a073a421c569 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:11.569392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acba861-d0f3-4bf8-9d0a-a073a421c569 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:11.571372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 686/1374] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:11.576348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c0e32-d8c7-4bc1-b7cd-1c4e34a49b1d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:11.577083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c0e32-d8c7-4bc1-b7cd-1c4e34a49b1d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:11.577364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c0e32-d8c7-4bc1-b7cd-1c4e34a49b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:11.595635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-591c0e32-d8c7-4bc1-b7cd-1c4e34a49b1d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:11.596834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-591c0e32-d8c7-4bc1-b7cd-1c4e34a49b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:11.604616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 689/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:11.653513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acba861-d0f3-4bf8-9d0a-a073a421c569 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:11.672053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acba861-d0f3-4bf8-9d0a-a073a421c569 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:11.678466 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ced4-e472-42f1-88ea-a7e7d0588685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:11.679213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ced4-e472-42f1-88ea-a7e7d0588685 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:11.679705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ced4-e472-42f1-88ea-a7e7d0588685 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:11.680187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ced4-e472-42f1-88ea-a7e7d0588685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:11.689516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ced4-e472-42f1-88ea-a7e7d0588685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:11.691433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ced4-e472-42f1-88ea-a7e7d0588685 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:11.705978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 687/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:30:14.836553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b9ed-aa77-4e4b-93f4-a9a2cd7bd9d4 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:14.837744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b9ed-aa77-4e4b-93f4-a9a2cd7bd9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:14.838178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b9ed-aa77-4e4b-93f4-a9a2cd7bd9d4 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:14.840210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 690/1377] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:14.847055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452953d-7bf5-4d12-81fb-2eedbb4de1a5 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:14.847785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452953d-7bf5-4d12-81fb-2eedbb4de1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:14.847785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452953d-7bf5-4d12-81fb-2eedbb4de1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:14.868102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6452953d-7bf5-4d12-81fb-2eedbb4de1a5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:14.869457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6452953d-7bf5-4d12-81fb-2eedbb4de1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:14.879687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 688/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:30:14.929072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530d8a-c756-4c7c-8f8b-baefa26a988a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:14.929447 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530d8a-c756-4c7c-8f8b-baefa26a988a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:14.929811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530d8a-c756-4c7c-8f8b-baefa26a988a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:14.931646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 691/1379] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jan 10 11:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:14.941383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42f902-aa2b-49e0-846c-56cea0158f50 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:14.941907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42f902-aa2b-49e0-846c-56cea0158f50 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:14.942378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42f902-aa2b-49e0-846c-56cea0158f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:14.964175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-de42f902-aa2b-49e0-846c-56cea0158f50 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:14.965832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-de42f902-aa2b-49e0-846c-56cea0158f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:14.976327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 689/1380] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jan 10 11:30:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:14.983919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530d8a-c756-4c7c-8f8b-baefa26a988a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:14.999201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530d8a-c756-4c7c-8f8b-baefa26a988a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:15.005619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcebba-df35-47ab-819b-180489664935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:15.006461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcebba-df35-47ab-819b-180489664935 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:15.006825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcebba-df35-47ab-819b-180489664935 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:15.007192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcebba-df35-47ab-819b-180489664935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:15.016085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcebba-df35-47ab-819b-180489664935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:15.017788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcebba-df35-47ab-819b-180489664935 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:15.034160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 692/1381] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:17.181100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8037c-fab6-4bc5-993b-110437d329e7 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.181744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8037c-fab6-4bc5-993b-110437d329e7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.181744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8037c-fab6-4bc5-993b-110437d329e7 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:17.183477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 690/1382] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:17.190719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ff2ca-8c26-4645-9cf6-decef055d59e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.191710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ff2ca-8c26-4645-9cf6-decef055d59e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.192173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ff2ca-8c26-4645-9cf6-decef055d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:17.212425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b82ff2ca-8c26-4645-9cf6-decef055d59e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:17.213680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b82ff2ca-8c26-4645-9cf6-decef055d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:17.226259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 693/1383] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:30:17.279531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1984f-b97b-43f8-94a4-d4a9289127b9 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.279819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1984f-b97b-43f8-94a4-d4a9289127b9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.280280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1984f-b97b-43f8-94a4-d4a9289127b9 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:17.282870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 691/1384] 10.222.0.20 () {54 vars in 963 bytes} [Mon Jan 10 11:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:17.288289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c783c-b4db-4c5f-8a3f-1587f4d2fccb None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.288701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c783c-b4db-4c5f-8a3f-1587f4d2fccb None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.289080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c783c-b4db-4c5f-8a3f-1587f4d2fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:17.346562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7a3c783c-b4db-4c5f-8a3f-1587f4d2fccb None None] MFA Rules not processed for user `a04d0effd2d54f28af90ede3c495a368`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:17.348053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7a3c783c-b4db-4c5f-8a3f-1587f4d2fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:17.432033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 694/1385] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Jan 10 11:30:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:17.440462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1984f-b97b-43f8-94a4-d4a9289127b9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:17.450964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1984f-b97b-43f8-94a4-d4a9289127b9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:17.455114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0af31-6e92-48f2-adc0-4fc350d6e575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:17.455746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0af31-6e92-48f2-adc0-4fc350d6e575 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.456028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0af31-6e92-48f2-adc0-4fc350d6e575 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.456301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0af31-6e92-48f2-adc0-4fc350d6e575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:17.465590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0af31-6e92-48f2-adc0-4fc350d6e575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:17.467288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0af31-6e92-48f2-adc0-4fc350d6e575 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:17.477248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 692/1386] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:17.990539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4dc2c-a6a5-4969-a160-8d5673d65028 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.990539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4dc2c-a6a5-4969-a160-8d5673d65028 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.990539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4dc2c-a6a5-4969-a160-8d5673d65028 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:17.990950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 695/1387] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:17.992969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d669-ea4f-482a-913a-8afe73b3875c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:17.993259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d669-ea4f-482a-913a-8afe73b3875c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:17.993533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7d669-ea4f-482a-913a-8afe73b3875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:18.014945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3ba7d669-ea4f-482a-913a-8afe73b3875c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:18.019152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3ba7d669-ea4f-482a-913a-8afe73b3875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:18.024989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 693/1388] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:18.073584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4dc2c-a6a5-4969-a160-8d5673d65028 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:18.087727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4dc2c-a6a5-4969-a160-8d5673d65028 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:18.100709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea734880-0271-4d86-b2ff-55485a108a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:18.100709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734880-0271-4d86-b2ff-55485a108a94 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:18.100709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734880-0271-4d86-b2ff-55485a108a94 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:18.100709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734880-0271-4d86-b2ff-55485a108a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:18.121301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734880-0271-4d86-b2ff-55485a108a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:18.123230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea734880-0271-4d86-b2ff-55485a108a94 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:18.140039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 696/1389] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:20.890492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4d22-15f0-4c55-afbd-f614141f2a0b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:20.891728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4d22-15f0-4c55-afbd-f614141f2a0b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:20.891728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4d22-15f0-4c55-afbd-f614141f2a0b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:20.897400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 694/1390] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:20.898113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e134db-3c21-4e3c-9674-26eefa25f7ab None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:20.898684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e134db-3c21-4e3c-9674-26eefa25f7ab None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:20.898684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e134db-3c21-4e3c-9674-26eefa25f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:20.928881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-82e134db-3c21-4e3c-9674-26eefa25f7ab None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:20.930087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-82e134db-3c21-4e3c-9674-26eefa25f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:20.941168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 697/1391] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:20.992202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4d22-15f0-4c55-afbd-f614141f2a0b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:21.019099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4d22-15f0-4c55-afbd-f614141f2a0b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:21.030349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f3f64-3678-4be9-af29-dff0d8459d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:21.031748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3f64-3678-4be9-af29-dff0d8459d69 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:21.031907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3f64-3678-4be9-af29-dff0d8459d69 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:21.032086 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f3f64-3678-4be9-af29-dff0d8459d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:21.041296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3f64-3678-4be9-af29-dff0d8459d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:21.043033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f3f64-3678-4be9-af29-dff0d8459d69 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:21.053636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 695/1392] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:23.757965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e534c4-2951-484e-af26-6926f8516f4d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:23.758565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e534c4-2951-484e-af26-6926f8516f4d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:23.758565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e534c4-2951-484e-af26-6926f8516f4d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:23.760288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 698/1393] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:23.765983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185b9c-518d-42aa-a0af-b11eb887a3d2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:23.766481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185b9c-518d-42aa-a0af-b11eb887a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:23.766574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f185b9c-518d-42aa-a0af-b11eb887a3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:23.785015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8f185b9c-518d-42aa-a0af-b11eb887a3d2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:23.786205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8f185b9c-518d-42aa-a0af-b11eb887a3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:23.794251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 696/1394] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:23.841025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e534c4-2951-484e-af26-6926f8516f4d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:23.858300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e534c4-2951-484e-af26-6926f8516f4d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:23.865309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577f80-bd30-4cdb-a384-e60cc2a2127f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:23.865955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f80-bd30-4cdb-a384-e60cc2a2127f service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:23.866252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f80-bd30-4cdb-a384-e60cc2a2127f service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:23.866530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f80-bd30-4cdb-a384-e60cc2a2127f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:23.876372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577f80-bd30-4cdb-a384-e60cc2a2127f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:23.877987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577f80-bd30-4cdb-a384-e60cc2a2127f service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:23.887880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 699/1395] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:26.837553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d79fe-92b1-4b9e-a5b1-d0bc74f83af3 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:26.838107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d79fe-92b1-4b9e-a5b1-d0bc74f83af3 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:26.838267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d79fe-92b1-4b9e-a5b1-d0bc74f83af3 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:26.840615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 697/1396] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:26.851792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50b76a-8bd2-45cb-aa21-567d42711ae9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:26.852421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50b76a-8bd2-45cb-aa21-567d42711ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:26.852421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50b76a-8bd2-45cb-aa21-567d42711ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:26.875710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7a50b76a-8bd2-45cb-aa21-567d42711ae9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:26.877015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7a50b76a-8bd2-45cb-aa21-567d42711ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:26.886474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 700/1397] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:26.929557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d79fe-92b1-4b9e-a5b1-d0bc74f83af3 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:26.944253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d79fe-92b1-4b9e-a5b1-d0bc74f83af3 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:26.950274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5b095-48d9-4092-b2c4-50679207d6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:26.950889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5b095-48d9-4092-b2c4-50679207d6ae service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:26.951197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5b095-48d9-4092-b2c4-50679207d6ae service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:26.951433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5b095-48d9-4092-b2c4-50679207d6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:26.961881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5b095-48d9-4092-b2c4-50679207d6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:26.963992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5b095-48d9-4092-b2c4-50679207d6ae service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:26.979956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 698/1398] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:30:29.572976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57384b1e-c7a9-4397-97da-ff808d7f6c27 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:29.573797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57384b1e-c7a9-4397-97da-ff808d7f6c27 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:29.573797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57384b1e-c7a9-4397-97da-ff808d7f6c27 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:29.575962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 701/1399] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:29.582101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbbab8-8e28-4a66-8c87-21f4845ba991 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:29.582677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbbab8-8e28-4a66-8c87-21f4845ba991 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:29.582773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbbab8-8e28-4a66-8c87-21f4845ba991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:29.605156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d9dbbab8-8e28-4a66-8c87-21f4845ba991 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:29.606403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d9dbbab8-8e28-4a66-8c87-21f4845ba991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:29.617397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 699/1400] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:30:29.664723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57384b1e-c7a9-4397-97da-ff808d7f6c27 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:29.681071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57384b1e-c7a9-4397-97da-ff808d7f6c27 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:29.686994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687523-6ceb-4fcc-87c5-6d4855df6172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:29.687676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687523-6ceb-4fcc-87c5-6d4855df6172 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:29.687954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687523-6ceb-4fcc-87c5-6d4855df6172 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:29.688227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687523-6ceb-4fcc-87c5-6d4855df6172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:29.700188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687523-6ceb-4fcc-87c5-6d4855df6172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:29.704955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687523-6ceb-4fcc-87c5-6d4855df6172 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:29.728265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 702/1401] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:32.769977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22a9e3-c954-42d4-802d-9364ea1508ee None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:32.770569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22a9e3-c954-42d4-802d-9364ea1508ee None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:32.770569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22a9e3-c954-42d4-802d-9364ea1508ee None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:32.772414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 700/1402] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:32.777603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637d66-37d9-4473-ab51-7bdaf0795ccc None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:32.778083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637d66-37d9-4473-ab51-7bdaf0795ccc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:32.778296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d637d66-37d9-4473-ab51-7bdaf0795ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:32.797813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4d637d66-37d9-4473-ab51-7bdaf0795ccc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:32.798979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4d637d66-37d9-4473-ab51-7bdaf0795ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:32.810522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 703/1403] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:32.862181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22a9e3-c954-42d4-802d-9364ea1508ee None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:32.878368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22a9e3-c954-42d4-802d-9364ea1508ee None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:32.884114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d74dff-d0c3-4746-8eb8-10abf6f2299d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:32.884759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d74dff-d0c3-4746-8eb8-10abf6f2299d service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:32.885047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d74dff-d0c3-4746-8eb8-10abf6f2299d service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:32.885356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d74dff-d0c3-4746-8eb8-10abf6f2299d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:32.896591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d74dff-d0c3-4746-8eb8-10abf6f2299d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:32.898309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d74dff-d0c3-4746-8eb8-10abf6f2299d service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:32.909468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 701/1404] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:33.542285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec57f1-151b-41d6-91f4-bbc254b36eb8 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:33.542552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec57f1-151b-41d6-91f4-bbc254b36eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:33.542827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec57f1-151b-41d6-91f4-bbc254b36eb8 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:33.544605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 704/1405] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:33.551047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653016-028a-4e1a-9807-1caed8f8634d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:33.551334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653016-028a-4e1a-9807-1caed8f8634d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:33.551607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653016-028a-4e1a-9807-1caed8f8634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:33.571143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-de653016-028a-4e1a-9807-1caed8f8634d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:33.572336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-de653016-028a-4e1a-9807-1caed8f8634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:33.581267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 702/1406] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:33.640208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619286-2f65-43ed-bf10-97024a30e709 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:33.640504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619286-2f65-43ed-bf10-97024a30e709 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:33.640789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77619286-2f65-43ed-bf10-97024a30e709 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:33.642615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 705/1407] 10.222.0.20 () {54 vars in 962 bytes} [Mon Jan 10 11:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:33.648297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132dc2-f5ef-4af8-888b-357a8c25ed95 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:33.648587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132dc2-f5ef-4af8-888b-357a8c25ed95 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:33.648855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132dc2-f5ef-4af8-888b-357a8c25ed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:33.705998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-32132dc2-f5ef-4af8-888b-357a8c25ed95 None None] MFA Rules not processed for user `86a45f34ca2b48e1ad61d3064715625f`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:33.707194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-32132dc2-f5ef-4af8-888b-357a8c25ed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:33.774395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 703/1408] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Jan 10 11:30:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:30:33.782618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77619286-2f65-43ed-bf10-97024a30e709 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:33.794772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77619286-2f65-43ed-bf10-97024a30e709 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:33.799350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607181-7f3d-4e97-a781-e9ff7e83ba49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:33.800107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607181-7f3d-4e97-a781-e9ff7e83ba49 service glance] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:33.803158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607181-7f3d-4e97-a781-e9ff7e83ba49 service glance] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:33.803158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607181-7f3d-4e97-a781-e9ff7e83ba49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:33.813375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607181-7f3d-4e97-a781-e9ff7e83ba49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:33.815073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607181-7f3d-4e97-a781-e9ff7e83ba49 service glance] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:33.828250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 706/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:34.856492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517245d-b9e6-421d-bef3-65a509cccffb None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:34.857006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517245d-b9e6-421d-bef3-65a509cccffb None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:34.857112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517245d-b9e6-421d-bef3-65a509cccffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:34.919736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4517245d-b9e6-421d-bef3-65a509cccffb None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:34.921845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4517245d-b9e6-421d-bef3-65a509cccffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:34.992949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 704/1410] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:30:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:35.038883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7160-0572-487e-85ff-5a0dca4c06bc None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:35.039431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7160-0572-487e-85ff-5a0dca4c06bc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:35.039431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d7160-0572-487e-85ff-5a0dca4c06bc None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:35.041189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 707/1411] 10.222.0.20 () {54 vars in 942 bytes} [Mon Jan 10 11:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:35.050459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e83d-be09-4fbf-aca0-3677757f302e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:35.050761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e83d-be09-4fbf-aca0-3677757f302e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:35.051085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e83d-be09-4fbf-aca0-3677757f302e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:35.106444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-db73e83d-be09-4fbf-aca0-3677757f302e None None] MFA Rules not processed for user `bccfc902f07f4298afeba04f08176891`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:35.108610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-db73e83d-be09-4fbf-aca0-3677757f302e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:35.186187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 705/1412] 10.222.0.20 () {58 vars in 1039 bytes} [Mon Jan 10 11:30:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:35.196445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d7160-0572-487e-85ff-5a0dca4c06bc None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:35.212391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d7160-0572-487e-85ff-5a0dca4c06bc None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:35.218431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00466526-4dae-4c17-89a1-30e78d261dec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:35.219323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00466526-4dae-4c17-89a1-30e78d261dec service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:35.219605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00466526-4dae-4c17-89a1-30e78d261dec service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:35.219894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00466526-4dae-4c17-89a1-30e78d261dec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:35.230249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00466526-4dae-4c17-89a1-30e78d261dec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:35.232055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00466526-4dae-4c17-89a1-30e78d261dec service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:35.243572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 708/1413] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:30:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:30:35.799199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb8aaf-3855-4d48-8681-50beea7e4eec None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:35.799486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb8aaf-3855-4d48-8681-50beea7e4eec None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:35.799760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb8aaf-3855-4d48-8681-50beea7e4eec None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:35.801596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 706/1414] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:35.807059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a5eae-2410-4b0a-98c7-a73c3e9cb3cc None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:35.807421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a5eae-2410-4b0a-98c7-a73c3e9cb3cc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:35.807669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a5eae-2410-4b0a-98c7-a73c3e9cb3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:35.836247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-244a5eae-2410-4b0a-98c7-a73c3e9cb3cc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:35.838955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-244a5eae-2410-4b0a-98c7-a73c3e9cb3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:35.858651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 709/1415] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:35.910464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb8aaf-3855-4d48-8681-50beea7e4eec None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:35.937710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb8aaf-3855-4d48-8681-50beea7e4eec None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:35.946108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16846143-2630-43e6-a310-41db6c05ad0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:35.946971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16846143-2630-43e6-a310-41db6c05ad0d service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:35.947260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16846143-2630-43e6-a310-41db6c05ad0d service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:35.947537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16846143-2630-43e6-a310-41db6c05ad0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:35.979861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16846143-2630-43e6-a310-41db6c05ad0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:35.981486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16846143-2630-43e6-a310-41db6c05ad0d service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:36.009194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 707/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:38.876369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6573c0-5da8-440d-861c-6dca6983b1bf None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:38.876950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6573c0-5da8-440d-861c-6dca6983b1bf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:38.876950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6573c0-5da8-440d-861c-6dca6983b1bf None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:38.883118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 710/1417] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:38.888724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89a832-172d-4054-8710-3b00efb8ac8b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:38.889641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89a832-172d-4054-8710-3b00efb8ac8b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:38.889927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89a832-172d-4054-8710-3b00efb8ac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:38.917301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2b89a832-172d-4054-8710-3b00efb8ac8b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:38.918633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2b89a832-172d-4054-8710-3b00efb8ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:38.934663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 708/1418] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:38.980677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6573c0-5da8-440d-861c-6dca6983b1bf None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:38.997189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6573c0-5da8-440d-861c-6dca6983b1bf None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:39.004721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9116807-da08-4323-a88d-499c7d68ccb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:39.005424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9116807-da08-4323-a88d-499c7d68ccb6 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:39.005636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9116807-da08-4323-a88d-499c7d68ccb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:39.005914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9116807-da08-4323-a88d-499c7d68ccb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:39.017055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9116807-da08-4323-a88d-499c7d68ccb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:39.018731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9116807-da08-4323-a88d-499c7d68ccb6 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:39.031349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 711/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:30:41.922545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afab5-cdd4-498a-a0d0-c33711529700 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:41.923431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afab5-cdd4-498a-a0d0-c33711529700 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:41.923707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afab5-cdd4-498a-a0d0-c33711529700 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:41.925667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 709/1420] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:30:41.935226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd9b3-c995-49b8-8810-23bd669304c9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:41.935839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd9b3-c995-49b8-8810-23bd669304c9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:41.935939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd9b3-c995-49b8-8810-23bd669304c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:41.956889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-965cd9b3-c995-49b8-8810-23bd669304c9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:30:41.958576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-965cd9b3-c995-49b8-8810-23bd669304c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:30:41.971320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 712/1421] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:30:42.020152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411afab5-cdd4-498a-a0d0-c33711529700 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:30:42.037326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411afab5-cdd4-498a-a0d0-c33711529700 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:30:42.047258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75671a4d-d47d-4547-9218-60f0171c6f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:30:42.048543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75671a4d-d47d-4547-9218-60f0171c6f9c service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:30:42.049004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75671a4d-d47d-4547-9218-60f0171c6f9c service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:30:42.049470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75671a4d-d47d-4547-9218-60f0171c6f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:30:42.059217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75671a4d-d47d-4547-9218-60f0171c6f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:30:42.060883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75671a4d-d47d-4547-9218-60f0171c6f9c service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:30:42.071213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 710/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:31:01.260888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109322-11d2-4ed7-a849-7b8926112e3d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:01.261657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109322-11d2-4ed7-a849-7b8926112e3d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:01.261657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9109322-11d2-4ed7-a849-7b8926112e3d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:01.263384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 713/1423] 10.222.0.20 () {54 vars in 918 bytes} [Mon Jan 10 11:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:01.269145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bbc1-8b87-4a17-a2e7-d8f1d8b95794 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:01.269783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bbc1-8b87-4a17-a2e7-d8f1d8b95794 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:01.269783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bbc1-8b87-4a17-a2e7-d8f1d8b95794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:01.289021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6842bbc1-8b87-4a17-a2e7-d8f1d8b95794 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:01.290196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6842bbc1-8b87-4a17-a2e7-d8f1d8b95794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:01.299303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 711/1424] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Jan 10 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:01.313595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ef13-fb4e-46c3-9bbe-01ee92f26292 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:01.313898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ef13-fb4e-46c3-9bbe-01ee92f26292 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:01.314172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95ef13-fb4e-46c3-9bbe-01ee92f26292 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:01.315941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 714/1425] 10.222.0.20 () {54 vars in 918 bytes} [Mon Jan 10 11:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:01.320445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2c55-e5a7-421c-a8e0-12cc4988f68c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:01.320776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2c55-e5a7-421c-a8e0-12cc4988f68c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:01.321053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2c55-e5a7-421c-a8e0-12cc4988f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:01.340319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-534d2c55-e5a7-421c-a8e0-12cc4988f68c None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:01.341505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-534d2c55-e5a7-421c-a8e0-12cc4988f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:01.350515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 712/1426] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Jan 10 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:31:04.206182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c076-29ac-4a28-868a-03c1b200bc5e None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:04.206799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c076-29ac-4a28-868a-03c1b200bc5e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:04.206799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44c076-29ac-4a28-868a-03c1b200bc5e None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:04.208486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 715/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:04.215290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18fce2-19fd-416e-9d00-856e5a84e67d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:04.220051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18fce2-19fd-416e-9d00-856e5a84e67d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:04.220051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18fce2-19fd-416e-9d00-856e5a84e67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:04.239834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ea18fce2-19fd-416e-9d00-856e5a84e67d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:04.241059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ea18fce2-19fd-416e-9d00-856e5a84e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:04.251929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 713/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:04.295683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44c076-29ac-4a28-868a-03c1b200bc5e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:04.310428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44c076-29ac-4a28-868a-03c1b200bc5e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:04.315860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec7ff8-6db1-4cf7-a8de-61befb287156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:04.316485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec7ff8-6db1-4cf7-a8de-61befb287156 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:04.316758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec7ff8-6db1-4cf7-a8de-61befb287156 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:04.317027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec7ff8-6db1-4cf7-a8de-61befb287156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:04.325177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec7ff8-6db1-4cf7-a8de-61befb287156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:04.326915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec7ff8-6db1-4cf7-a8de-61befb287156 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:04.336116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 716/1429] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:06.004161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0897e7-45b7-4ffa-9cdc-db21880a9e63 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:06.004755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0897e7-45b7-4ffa-9cdc-db21880a9e63 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:06.004755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0897e7-45b7-4ffa-9cdc-db21880a9e63 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:06.006567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 714/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:06.012292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66405aa-1235-45de-ba75-6f9e1a64ea30 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:06.012773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66405aa-1235-45de-ba75-6f9e1a64ea30 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:06.012908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66405aa-1235-45de-ba75-6f9e1a64ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:06.031320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c66405aa-1235-45de-ba75-6f9e1a64ea30 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:06.032500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c66405aa-1235-45de-ba75-6f9e1a64ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:06.040206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 717/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:06.196908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0897e7-45b7-4ffa-9cdc-db21880a9e63 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:06.216836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0897e7-45b7-4ffa-9cdc-db21880a9e63 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:06.223676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce92559-1a75-4135-bb27-3f3fc8bd30ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:06.224534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce92559-1a75-4135-bb27-3f3fc8bd30ef service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:06.224828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce92559-1a75-4135-bb27-3f3fc8bd30ef service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:06.225107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce92559-1a75-4135-bb27-3f3fc8bd30ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:06.233748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce92559-1a75-4135-bb27-3f3fc8bd30ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:06.235650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce92559-1a75-4135-bb27-3f3fc8bd30ef service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:06.245432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 715/1432] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:07.870968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2742c59-7d29-41e5-8ef3-39beb0a6f971 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:07.871519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2742c59-7d29-41e5-8ef3-39beb0a6f971 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:07.871519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2742c59-7d29-41e5-8ef3-39beb0a6f971 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:07.873296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 718/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:07.878786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e25c-d5d0-4695-89bb-6f1bdd80bf30 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:07.879225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e25c-d5d0-4695-89bb-6f1bdd80bf30 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:07.879339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e25c-d5d0-4695-89bb-6f1bdd80bf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:07.898463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0a49e25c-d5d0-4695-89bb-6f1bdd80bf30 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:07.899761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0a49e25c-d5d0-4695-89bb-6f1bdd80bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:07.908319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 716/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:08.060844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2742c59-7d29-41e5-8ef3-39beb0a6f971 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:08.074837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2742c59-7d29-41e5-8ef3-39beb0a6f971 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:08.080096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308fffb-ae58-4ca8-97f6-57cb154ce539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:08.080721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308fffb-ae58-4ca8-97f6-57cb154ce539 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:08.080998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308fffb-ae58-4ca8-97f6-57cb154ce539 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:08.081263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308fffb-ae58-4ca8-97f6-57cb154ce539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:08.089708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308fffb-ae58-4ca8-97f6-57cb154ce539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:08.091351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308fffb-ae58-4ca8-97f6-57cb154ce539 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:08.100506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 719/1435] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:09.704242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc290-e755-4323-b03c-22599ef35392 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:09.704784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc290-e755-4323-b03c-22599ef35392 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:09.704784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffc290-e755-4323-b03c-22599ef35392 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:09.706551 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 717/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:09.711420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695ba03-79bd-41cd-9561-970ecf0ec673 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:09.711862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695ba03-79bd-41cd-9561-970ecf0ec673 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:09.711982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695ba03-79bd-41cd-9561-970ecf0ec673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:09.731733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7695ba03-79bd-41cd-9561-970ecf0ec673 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:09.732953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7695ba03-79bd-41cd-9561-970ecf0ec673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:09.741124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 720/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:09.896198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc290-e755-4323-b03c-22599ef35392 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:09.911145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffc290-e755-4323-b03c-22599ef35392 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:09.916555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2cfc1-6092-445d-a7b1-8dbbcb80012e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:09.917315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2cfc1-6092-445d-a7b1-8dbbcb80012e service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:09.917600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2cfc1-6092-445d-a7b1-8dbbcb80012e service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:09.917874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2cfc1-6092-445d-a7b1-8dbbcb80012e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:09.925794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2cfc1-6092-445d-a7b1-8dbbcb80012e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:09.927686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2cfc1-6092-445d-a7b1-8dbbcb80012e service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:09.937599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 718/1438] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:11.575996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669860e0-5f67-4217-ae17-a06baf337d3b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:11.576560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669860e0-5f67-4217-ae17-a06baf337d3b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:11.576560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669860e0-5f67-4217-ae17-a06baf337d3b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:11.578325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 721/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:11.583316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858aa4-f3d8-4876-8d38-650cc01d4507 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:11.583791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858aa4-f3d8-4876-8d38-650cc01d4507 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:11.583897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858aa4-f3d8-4876-8d38-650cc01d4507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:11.602589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e1858aa4-f3d8-4876-8d38-650cc01d4507 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:11.603878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e1858aa4-f3d8-4876-8d38-650cc01d4507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:11.617082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 719/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:11.770539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669860e0-5f67-4217-ae17-a06baf337d3b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:11.785296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669860e0-5f67-4217-ae17-a06baf337d3b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:11.791172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487288ef-6a6e-46f1-b7a2-baac42378b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:11.793049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487288ef-6a6e-46f1-b7a2-baac42378b08 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:11.793331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487288ef-6a6e-46f1-b7a2-baac42378b08 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:11.793609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487288ef-6a6e-46f1-b7a2-baac42378b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:11.802295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487288ef-6a6e-46f1-b7a2-baac42378b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:11.804001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487288ef-6a6e-46f1-b7a2-baac42378b08 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:11.813905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 722/1441] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:13.424259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd0d64-88e3-46a6-a6a4-3a4b7e2e1337 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:13.424811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd0d64-88e3-46a6-a6a4-3a4b7e2e1337 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:13.424811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd0d64-88e3-46a6-a6a4-3a4b7e2e1337 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:13.426616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 720/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:13.431512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bbd9-1ec5-41b3-8110-6e9550f058cf None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:13.431928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bbd9-1ec5-41b3-8110-6e9550f058cf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:13.432071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bbd9-1ec5-41b3-8110-6e9550f058cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:13.450407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f240bbd9-1ec5-41b3-8110-6e9550f058cf None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:13.451616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f240bbd9-1ec5-41b3-8110-6e9550f058cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:13.459455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 723/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:31:13.623881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd0d64-88e3-46a6-a6a4-3a4b7e2e1337 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:13.638202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd0d64-88e3-46a6-a6a4-3a4b7e2e1337 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:13.643411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec987293-3bfe-46df-b7e6-e80bf42c3eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:13.644024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987293-3bfe-46df-b7e6-e80bf42c3eed service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:13.644302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987293-3bfe-46df-b7e6-e80bf42c3eed service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:13.644573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987293-3bfe-46df-b7e6-e80bf42c3eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:13.652966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987293-3bfe-46df-b7e6-e80bf42c3eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:13.654576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec987293-3bfe-46df-b7e6-e80bf42c3eed service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:13.663607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 721/1444] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:15.367791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ddded-9c95-415c-bffd-ff35523848ec None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:15.368422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ddded-9c95-415c-bffd-ff35523848ec None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:15.368422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ddded-9c95-415c-bffd-ff35523848ec None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:15.370727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 724/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:15.376158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6610-68f1-478b-90d2-51d628a76409 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:15.376612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6610-68f1-478b-90d2-51d628a76409 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:15.376703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d6610-68f1-478b-90d2-51d628a76409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:15.396869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2a2d6610-68f1-478b-90d2-51d628a76409 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:15.398078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2a2d6610-68f1-478b-90d2-51d628a76409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:15.406523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 722/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:15.565658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ddded-9c95-415c-bffd-ff35523848ec None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:15.580623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ddded-9c95-415c-bffd-ff35523848ec None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:15.585975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58c6bd-0ccb-4ff8-bd6f-1f808718607a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:15.586636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c6bd-0ccb-4ff8-bd6f-1f808718607a service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:15.586915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c6bd-0ccb-4ff8-bd6f-1f808718607a service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:15.587188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58c6bd-0ccb-4ff8-bd6f-1f808718607a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:15.595710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58c6bd-0ccb-4ff8-bd6f-1f808718607a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:15.597292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58c6bd-0ccb-4ff8-bd6f-1f808718607a service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:15.607489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 725/1447] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:17.256380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72cb0-e08d-4cce-b47c-1444f3b9480f None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:17.256970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72cb0-e08d-4cce-b47c-1444f3b9480f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:17.256970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72cb0-e08d-4cce-b47c-1444f3b9480f None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:17.258746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 723/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:17.264518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b08df0-8b5b-4095-bf7f-098e2b4e1ddd None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:17.264975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b08df0-8b5b-4095-bf7f-098e2b4e1ddd None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:17.265086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b08df0-8b5b-4095-bf7f-098e2b4e1ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:17.287175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a2b08df0-8b5b-4095-bf7f-098e2b4e1ddd None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:17.288362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a2b08df0-8b5b-4095-bf7f-098e2b4e1ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:17.297317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 726/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:17.452026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72cb0-e08d-4cce-b47c-1444f3b9480f None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:17.465559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72cb0-e08d-4cce-b47c-1444f3b9480f None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:17.470849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e890f-40d1-46f5-ab1b-6ecbbfc6e8b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:17.471470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e890f-40d1-46f5-ab1b-6ecbbfc6e8b8 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:17.471751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e890f-40d1-46f5-ab1b-6ecbbfc6e8b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:17.472025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e890f-40d1-46f5-ab1b-6ecbbfc6e8b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:17.480093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e890f-40d1-46f5-ab1b-6ecbbfc6e8b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:17.481732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e890f-40d1-46f5-ab1b-6ecbbfc6e8b8 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:17.491730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 724/1450] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:19.098368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3153-b5f0-4330-80a8-688f40b58964 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:19.098917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3153-b5f0-4330-80a8-688f40b58964 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:19.099015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d3153-b5f0-4330-80a8-688f40b58964 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:19.100768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 727/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:19.106602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd56bf-99cc-4201-a1c9-56e7b769007e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:19.107018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd56bf-99cc-4201-a1c9-56e7b769007e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:19.107146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd56bf-99cc-4201-a1c9-56e7b769007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:19.124895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-1fdd56bf-99cc-4201-a1c9-56e7b769007e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:19.126066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1fdd56bf-99cc-4201-a1c9-56e7b769007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:19.133773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 725/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:19.292164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3153-b5f0-4330-80a8-688f40b58964 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:19.308085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d3153-b5f0-4330-80a8-688f40b58964 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:19.313707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3a964-8f9d-4ba4-9c50-a3dd89cc31df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:19.314395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3a964-8f9d-4ba4-9c50-a3dd89cc31df service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:19.314708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3a964-8f9d-4ba4-9c50-a3dd89cc31df service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:19.314939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3a964-8f9d-4ba4-9c50-a3dd89cc31df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:19.324739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3a964-8f9d-4ba4-9c50-a3dd89cc31df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:19.326423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3a964-8f9d-4ba4-9c50-a3dd89cc31df service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:19.335907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 728/1453] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:21.655230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48b2fe-6f6f-473f-a9e0-337d9671c1aa None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:21.655837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48b2fe-6f6f-473f-a9e0-337d9671c1aa None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:21.655837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48b2fe-6f6f-473f-a9e0-337d9671c1aa None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:21.657536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 726/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:21.664035 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2f35-7656-4afa-94d8-ca43e000548f None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:21.664488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2f35-7656-4afa-94d8-ca43e000548f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:21.664604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2f35-7656-4afa-94d8-ca43e000548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:21.682129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-af2a2f35-7656-4afa-94d8-ca43e000548f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:21.683344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-af2a2f35-7656-4afa-94d8-ca43e000548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:21.691489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 729/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:31:21.735850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48b2fe-6f6f-473f-a9e0-337d9671c1aa None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:21.746554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48b2fe-6f6f-473f-a9e0-337d9671c1aa None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:21.750330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b97a10-b90e-4e56-ae9b-3a913caaa014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:21.750959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b97a10-b90e-4e56-ae9b-3a913caaa014 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:21.751239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b97a10-b90e-4e56-ae9b-3a913caaa014 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:21.751508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b97a10-b90e-4e56-ae9b-3a913caaa014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:21.761516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b97a10-b90e-4e56-ae9b-3a913caaa014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:21.762976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b97a10-b90e-4e56-ae9b-3a913caaa014 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:21.772102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 727/1456] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:31:24.403990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ac11-cb43-4966-a5f7-4911ece76c5d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:24.404634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ac11-cb43-4966-a5f7-4911ece76c5d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:24.404634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ac11-cb43-4966-a5f7-4911ece76c5d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:24.406323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 730/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:24.411868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29eadf-39a0-4660-8481-8bed31c34210 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:24.412288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29eadf-39a0-4660-8481-8bed31c34210 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:24.412400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29eadf-39a0-4660-8481-8bed31c34210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:24.430537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4b29eadf-39a0-4660-8481-8bed31c34210 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:24.432256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4b29eadf-39a0-4660-8481-8bed31c34210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:24.440090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 728/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:24.485767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ac11-cb43-4966-a5f7-4911ece76c5d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:24.497095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ac11-cb43-4966-a5f7-4911ece76c5d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:24.500606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e04e9-e83f-4587-b0ee-cf8a004cd2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:24.501229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e04e9-e83f-4587-b0ee-cf8a004cd2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:24.501865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e04e9-e83f-4587-b0ee-cf8a004cd2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:24.502143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e04e9-e83f-4587-b0ee-cf8a004cd2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:24.511788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e04e9-e83f-4587-b0ee-cf8a004cd2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:24.513210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e04e9-e83f-4587-b0ee-cf8a004cd2a8 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:24.522276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 731/1459] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:27.321924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630f797-54ae-4212-a641-7c3f2f745136 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:27.322550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630f797-54ae-4212-a641-7c3f2f745136 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:27.322550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630f797-54ae-4212-a641-7c3f2f745136 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:27.324291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 729/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:27.330865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6fda-5d35-458d-af00-e08be42cc454 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:27.331322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6fda-5d35-458d-af00-e08be42cc454 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:27.331434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c6fda-5d35-458d-af00-e08be42cc454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:27.349300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0f7c6fda-5d35-458d-af00-e08be42cc454 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:27.350503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0f7c6fda-5d35-458d-af00-e08be42cc454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:27.358853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 732/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:27.396690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630f797-54ae-4212-a641-7c3f2f745136 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:27.407897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630f797-54ae-4212-a641-7c3f2f745136 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:27.411472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7237a9f-16a2-4be3-8f41-dd4e61c7bb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:27.412097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7237a9f-16a2-4be3-8f41-dd4e61c7bb0c service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:27.412376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7237a9f-16a2-4be3-8f41-dd4e61c7bb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:27.412649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7237a9f-16a2-4be3-8f41-dd4e61c7bb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:27.422415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7237a9f-16a2-4be3-8f41-dd4e61c7bb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:27.423889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7237a9f-16a2-4be3-8f41-dd4e61c7bb0c service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:27.433260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 730/1462] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:29.988821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac3e1-74a9-417e-9cef-83167b3683d5 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:29.989390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac3e1-74a9-417e-9cef-83167b3683d5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:29.989390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac3e1-74a9-417e-9cef-83167b3683d5 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:29.991198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 733/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:29.997805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980d75-f44b-4406-bd41-0f2324d4e9ae None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:29.998281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980d75-f44b-4406-bd41-0f2324d4e9ae None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:29.998402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77980d75-f44b-4406-bd41-0f2324d4e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:30.016197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-77980d75-f44b-4406-bd41-0f2324d4e9ae None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:30.017414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-77980d75-f44b-4406-bd41-0f2324d4e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:30.026168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 731/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:30.068306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ac3e1-74a9-417e-9cef-83167b3683d5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:30.080250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ac3e1-74a9-417e-9cef-83167b3683d5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:30.084078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d1146-0623-473d-b70d-15bb34e564ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:30.084770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d1146-0623-473d-b70d-15bb34e564ce service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:30.085121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d1146-0623-473d-b70d-15bb34e564ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:30.085436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d1146-0623-473d-b70d-15bb34e564ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:30.095797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d1146-0623-473d-b70d-15bb34e564ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:30.097235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d1146-0623-473d-b70d-15bb34e564ce service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:30.106658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 734/1465] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:32.662725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab810-bfa4-430e-b172-b411e5505f44 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:32.663438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab810-bfa4-430e-b172-b411e5505f44 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:32.663438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab810-bfa4-430e-b172-b411e5505f44 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:32.665418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 732/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:32.672372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c01ed-9db8-4a51-bdf6-fbaba50d7159 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:32.672838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c01ed-9db8-4a51-bdf6-fbaba50d7159 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:32.672934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c01ed-9db8-4a51-bdf6-fbaba50d7159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:32.691156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8e6c01ed-9db8-4a51-bdf6-fbaba50d7159 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:32.692335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8e6c01ed-9db8-4a51-bdf6-fbaba50d7159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:32.700653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 735/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:32.738789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab810-bfa4-430e-b172-b411e5505f44 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:32.750490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab810-bfa4-430e-b172-b411e5505f44 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:32.753965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4244cf8-376d-48d3-8dee-8ece70ea7964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:32.754617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244cf8-376d-48d3-8dee-8ece70ea7964 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:32.754952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244cf8-376d-48d3-8dee-8ece70ea7964 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:32.755174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244cf8-376d-48d3-8dee-8ece70ea7964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:32.764602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244cf8-376d-48d3-8dee-8ece70ea7964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:32.766048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4244cf8-376d-48d3-8dee-8ece70ea7964 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:32.775377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 733/1468] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:31:35.267099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66dc8-a3aa-49ea-958e-2bf1c3a651a2 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:35.267655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66dc8-a3aa-49ea-958e-2bf1c3a651a2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:35.267655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66dc8-a3aa-49ea-958e-2bf1c3a651a2 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:35.269391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 736/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:35.276851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba0d5-4fc1-4aff-9b2f-265562979e51 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:35.283719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba0d5-4fc1-4aff-9b2f-265562979e51 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:35.283719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba0d5-4fc1-4aff-9b2f-265562979e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:35.296680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-50eba0d5-4fc1-4aff-9b2f-265562979e51 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:35.297868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-50eba0d5-4fc1-4aff-9b2f-265562979e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:35.305546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 734/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:31:35.345435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66dc8-a3aa-49ea-958e-2bf1c3a651a2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:35.356111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66dc8-a3aa-49ea-958e-2bf1c3a651a2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:35.359861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe6cae-7397-47ea-91e5-50033c498c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:35.360479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6cae-7397-47ea-91e5-50033c498c99 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:35.360753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6cae-7397-47ea-91e5-50033c498c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:35.361023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6cae-7397-47ea-91e5-50033c498c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:35.369833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe6cae-7397-47ea-91e5-50033c498c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:35.371323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe6cae-7397-47ea-91e5-50033c498c99 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:35.380602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 737/1471] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:37.872038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c87a-97e9-43d6-94d0-0141c7d2514a None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:37.872634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c87a-97e9-43d6-94d0-0141c7d2514a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:37.872634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c87a-97e9-43d6-94d0-0141c7d2514a None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:37.874774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 735/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:37.881811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53442-dbf4-4721-be5e-bd80d2014618 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:37.882268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53442-dbf4-4721-be5e-bd80d2014618 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:37.882484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53442-dbf4-4721-be5e-bd80d2014618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:37.901512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-17f53442-dbf4-4721-be5e-bd80d2014618 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:37.902777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-17f53442-dbf4-4721-be5e-bd80d2014618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:37.913950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 738/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:31:37.954471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c87a-97e9-43d6-94d0-0141c7d2514a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:37.971050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c87a-97e9-43d6-94d0-0141c7d2514a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:37.975345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ac6c-e7e7-4a09-9b9e-6fcbe41e273b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:37.975988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ac6c-e7e7-4a09-9b9e-6fcbe41e273b service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:37.976271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ac6c-e7e7-4a09-9b9e-6fcbe41e273b service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:37.976547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ac6c-e7e7-4a09-9b9e-6fcbe41e273b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:37.987290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ac6c-e7e7-4a09-9b9e-6fcbe41e273b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:37.988743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ac6c-e7e7-4a09-9b9e-6fcbe41e273b service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:37.998206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 736/1474] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:40.486451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6430-a932-4f66-a4a7-36420126a68a None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:40.487020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6430-a932-4f66-a4a7-36420126a68a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:40.487020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6430-a932-4f66-a4a7-36420126a68a None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:40.488736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 739/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:40.496577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84dcc-25f8-4002-bd3d-1e2d66f89e56 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:40.497034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84dcc-25f8-4002-bd3d-1e2d66f89e56 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:40.497163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b84dcc-25f8-4002-bd3d-1e2d66f89e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:40.514801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-05b84dcc-25f8-4002-bd3d-1e2d66f89e56 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:40.516016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-05b84dcc-25f8-4002-bd3d-1e2d66f89e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:40.524395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 737/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:31:40.562827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6430-a932-4f66-a4a7-36420126a68a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:40.573503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6430-a932-4f66-a4a7-36420126a68a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:40.576975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27469be-63cf-4b81-9755-a0beda93f94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:40.577586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27469be-63cf-4b81-9755-a0beda93f94e service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:40.577864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27469be-63cf-4b81-9755-a0beda93f94e service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:40.578131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27469be-63cf-4b81-9755-a0beda93f94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:40.586826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27469be-63cf-4b81-9755-a0beda93f94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:40.588250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27469be-63cf-4b81-9755-a0beda93f94e service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:40.597458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 740/1477] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:43.036169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054380-0017-4f79-8116-6660c000475e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:43.036734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054380-0017-4f79-8116-6660c000475e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:43.036734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054380-0017-4f79-8116-6660c000475e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:43.038550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 738/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:43.045849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd51d01-6caa-4048-9e1b-956212dda813 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:43.046296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd51d01-6caa-4048-9e1b-956212dda813 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:43.046433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd51d01-6caa-4048-9e1b-956212dda813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:43.063755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2cd51d01-6caa-4048-9e1b-956212dda813 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:43.064939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2cd51d01-6caa-4048-9e1b-956212dda813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:43.072795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 741/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:43.110897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054380-0017-4f79-8116-6660c000475e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:43.121327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054380-0017-4f79-8116-6660c000475e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:43.124793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec547de-ca6d-4beb-b214-974e6fba100b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:43.125412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec547de-ca6d-4beb-b214-974e6fba100b service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:43.125696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec547de-ca6d-4beb-b214-974e6fba100b service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:43.125969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec547de-ca6d-4beb-b214-974e6fba100b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:43.135224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec547de-ca6d-4beb-b214-974e6fba100b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:43.136650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec547de-ca6d-4beb-b214-974e6fba100b service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:43.145630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 739/1480] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:45.603931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee284a-0cdf-4083-814e-6c1defa14c19 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:45.604498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee284a-0cdf-4083-814e-6c1defa14c19 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:45.604498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee284a-0cdf-4083-814e-6c1defa14c19 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:45.606223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 742/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:31:45.613069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbb6a-650e-40bd-9719-5187efdc3b56 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:45.613487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbb6a-650e-40bd-9719-5187efdc3b56 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:45.613625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbbb6a-650e-40bd-9719-5187efdc3b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:45.631993 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-60dbbb6a-650e-40bd-9719-5187efdc3b56 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:31:45.634119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-60dbbb6a-650e-40bd-9719-5187efdc3b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:31:45.641898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 740/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:31:45.679010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee284a-0cdf-4083-814e-6c1defa14c19 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:31:45.689314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee284a-0cdf-4083-814e-6c1defa14c19 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:31:45.692705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b948-c5bc-43e4-bda5-7a41290b01ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:31:45.693323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b948-c5bc-43e4-bda5-7a41290b01ea service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:31:45.693595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b948-c5bc-43e4-bda5-7a41290b01ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:31:45.693858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b948-c5bc-43e4-bda5-7a41290b01ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:31:45.702930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b948-c5bc-43e4-bda5-7a41290b01ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:31:45.704363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b948-c5bc-43e4-bda5-7a41290b01ea service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:31:45.714052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 743/1483] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:32:03.737534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a861dd-8f0a-4ff7-a2e5-e6141ce39254 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:03.738106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a861dd-8f0a-4ff7-a2e5-e6141ce39254 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:03.738106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a861dd-8f0a-4ff7-a2e5-e6141ce39254 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:03.740023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 741/1484] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:03.746235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe00e-c453-46b8-b70b-b574947f157e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:03.746702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe00e-c453-46b8-b70b-b574947f157e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:03.746808 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe00e-c453-46b8-b70b-b574947f157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:03.764851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6edbe00e-c453-46b8-b70b-b574947f157e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:03.766048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6edbe00e-c453-46b8-b70b-b574947f157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:03.774500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 744/1485] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:03.821916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90936-81c8-4bd9-a74f-2a39ae69b4d6 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:03.822373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90936-81c8-4bd9-a74f-2a39ae69b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:03.822759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90936-81c8-4bd9-a74f-2a39ae69b4d6 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:03.824623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 742/1486] 10.222.0.20 () {54 vars in 962 bytes} [Mon Jan 10 11:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:03.830588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e7f0-a013-46bf-95ec-a9de9cb5f3f3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:03.831180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e7f0-a013-46bf-95ec-a9de9cb5f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:03.831502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e7f0-a013-46bf-95ec-a9de9cb5f3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:03.849838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-84e0e7f0-a013-46bf-95ec-a9de9cb5f3f3 None None] MFA Rules not processed for user `86a45f34ca2b48e1ad61d3064715625f`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:03.851169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-84e0e7f0-a013-46bf-95ec-a9de9cb5f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:03.857797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 745/1487] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Jan 10 11:32:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:03.865538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd90936-81c8-4bd9-a74f-2a39ae69b4d6 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:03.876305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd90936-81c8-4bd9-a74f-2a39ae69b4d6 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:03.879843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfa0ff-83cf-4bf6-b8c6-159e93316ef7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:03.880469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfa0ff-83cf-4bf6-b8c6-159e93316ef7 service glance] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:03.880742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfa0ff-83cf-4bf6-b8c6-159e93316ef7 service glance] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:03.881016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfa0ff-83cf-4bf6-b8c6-159e93316ef7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:03.890363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfa0ff-83cf-4bf6-b8c6-159e93316ef7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:03.891786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfa0ff-83cf-4bf6-b8c6-159e93316ef7 service glance] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:03.902146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 743/1488] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:32:06.429232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720d874-8ac3-4dd8-b436-2f31ab348400 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:06.429804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720d874-8ac3-4dd8-b436-2f31ab348400 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:06.429804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720d874-8ac3-4dd8-b436-2f31ab348400 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:06.431607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 746/1489] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:06.438296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39dd2f-40c0-4ab2-9aa1-03f9b2792613 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:06.438697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39dd2f-40c0-4ab2-9aa1-03f9b2792613 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:06.438881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39dd2f-40c0-4ab2-9aa1-03f9b2792613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:06.457095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-7c39dd2f-40c0-4ab2-9aa1-03f9b2792613 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:06.458309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7c39dd2f-40c0-4ab2-9aa1-03f9b2792613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:06.466761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 744/1490] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:06.491979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720d874-8ac3-4dd8-b436-2f31ab348400 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:06.504371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720d874-8ac3-4dd8-b436-2f31ab348400 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:06.511392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f75d7-6934-41d6-ab0d-f15d53679df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:06.512044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f75d7-6934-41d6-ab0d-f15d53679df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:06.512321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f75d7-6934-41d6-ab0d-f15d53679df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:06.512590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f75d7-6934-41d6-ab0d-f15d53679df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:06.513332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f75d7-6934-41d6-ab0d-f15d53679df9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:06.516201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f75d7-6934-41d6-ab0d-f15d53679df9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:06.533770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 747/1491] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Jan 10 11:32:06 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:32:09.020984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f7c6-18cd-4710-bfc6-b68f487a402a None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:09.021642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f7c6-18cd-4710-bfc6-b68f487a402a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:09.021642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6f7c6-18cd-4710-bfc6-b68f487a402a None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:09.023582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 745/1492] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:09.030749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b225d2-45fd-409b-924c-c0372145f06a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:09.031246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b225d2-45fd-409b-924c-c0372145f06a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:09.031330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b225d2-45fd-409b-924c-c0372145f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:09.049316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-56b225d2-45fd-409b-924c-c0372145f06a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:09.050576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-56b225d2-45fd-409b-924c-c0372145f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:09.058961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 748/1493] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:09.102834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f7c6-18cd-4710-bfc6-b68f487a402a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:09.117870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6f7c6-18cd-4710-bfc6-b68f487a402a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:09.123270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd685309-3718-48ac-ae4e-a7ed820f4503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:09.123892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685309-3718-48ac-ae4e-a7ed820f4503 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:09.124167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685309-3718-48ac-ae4e-a7ed820f4503 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:09.124437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685309-3718-48ac-ae4e-a7ed820f4503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:09.133080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd685309-3718-48ac-ae4e-a7ed820f4503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:09.134713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd685309-3718-48ac-ae4e-a7ed820f4503 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:09.144142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 746/1494] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:32:11.814281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c521a-e031-43a0-8d8e-60b1e3bebb49 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:11.814791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c521a-e031-43a0-8d8e-60b1e3bebb49 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:11.814791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c521a-e031-43a0-8d8e-60b1e3bebb49 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:11.816479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 749/1495] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:11.822480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3472-95d1-48b0-8fdf-2416399ae605 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:11.822934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3472-95d1-48b0-8fdf-2416399ae605 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:11.823029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe3472-95d1-48b0-8fdf-2416399ae605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:11.841425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e9fe3472-95d1-48b0-8fdf-2416399ae605 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:11.842646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e9fe3472-95d1-48b0-8fdf-2416399ae605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:11.850744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 747/1496] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:11.889327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c521a-e031-43a0-8d8e-60b1e3bebb49 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:11.902262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c521a-e031-43a0-8d8e-60b1e3bebb49 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:11.906123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de5182-abea-4755-b05d-4aae0f44b70c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:11.906804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de5182-abea-4755-b05d-4aae0f44b70c service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:11.907115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de5182-abea-4755-b05d-4aae0f44b70c service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:11.907383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de5182-abea-4755-b05d-4aae0f44b70c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:11.917421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de5182-abea-4755-b05d-4aae0f44b70c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:11.918912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de5182-abea-4755-b05d-4aae0f44b70c service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:11.932840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 750/1497] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:32:14.476573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62c5b-5a47-463d-ab86-2a54632afc30 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:14.477168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62c5b-5a47-463d-ab86-2a54632afc30 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:14.477168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62c5b-5a47-463d-ab86-2a54632afc30 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:14.479053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 748/1498] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:14.484907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b42b5-faff-4759-9c6a-9eabff75e916 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:14.485393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b42b5-faff-4759-9c6a-9eabff75e916 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:14.485487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b42b5-faff-4759-9c6a-9eabff75e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:14.503835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ba9b42b5-faff-4759-9c6a-9eabff75e916 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:14.505127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ba9b42b5-faff-4759-9c6a-9eabff75e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:14.513279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 751/1499] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:14.554097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62c5b-5a47-463d-ab86-2a54632afc30 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:14.565179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62c5b-5a47-463d-ab86-2a54632afc30 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:14.568842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30183f76-28db-4e7d-bad6-0d7f76f733e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:14.569537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30183f76-28db-4e7d-bad6-0d7f76f733e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:14.569823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30183f76-28db-4e7d-bad6-0d7f76f733e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:14.570097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30183f76-28db-4e7d-bad6-0d7f76f733e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:14.579677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30183f76-28db-4e7d-bad6-0d7f76f733e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:14.581184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30183f76-28db-4e7d-bad6-0d7f76f733e3 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:14.591574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 749/1500] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:32:17.146574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb632-9d15-4dc1-a8c1-cf588e7a6201 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:17.147158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb632-9d15-4dc1-a8c1-cf588e7a6201 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:17.147265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eb632-9d15-4dc1-a8c1-cf588e7a6201 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:17.148955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 752/1501] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:17.154342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:17.154760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:17.154872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:17.172229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:17.173397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:17.181182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 750/1502] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:17.218676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1eb632-9d15-4dc1-a8c1-cf588e7a6201 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:17.231651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1eb632-9d15-4dc1-a8c1-cf588e7a6201 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:17.236773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544bf92-3b2a-4801-ab33-835820d07fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:17.236900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544bf92-3b2a-4801-ab33-835820d07fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:17.237148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544bf92-3b2a-4801-ab33-835820d07fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:17.237422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544bf92-3b2a-4801-ab33-835820d07fb6 admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:17.238640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544bf92-3b2a-4801-ab33-835820d07fb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:17.240471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544bf92-3b2a-4801-ab33-835820d07fb6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:17.242092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 753/1503] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:32:17 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:32:17.253642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:17.263292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9f2a6-2d6c-44fc-a76c-20e6cea16d63 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:17.266971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc29f55-f1ac-4a63-bdfa-82fe77137abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:17.267591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc29f55-f1ac-4a63-bdfa-82fe77137abe service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:17.267867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc29f55-f1ac-4a63-bdfa-82fe77137abe service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:17.268137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc29f55-f1ac-4a63-bdfa-82fe77137abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:17.277464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc29f55-f1ac-4a63-bdfa-82fe77137abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:17.278879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc29f55-f1ac-4a63-bdfa-82fe77137abe service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:17.288010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 751/1504] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:32:20.140467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd754a-a4be-47f2-9e10-1a39bb9bfe76 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:20.141032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd754a-a4be-47f2-9e10-1a39bb9bfe76 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:20.141032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd754a-a4be-47f2-9e10-1a39bb9bfe76 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:20.142787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 754/1505] 10.222.0.20 () {54 vars in 926 bytes} [Mon Jan 10 11:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:32:20.148113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:20.148543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:20.148656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:20.166481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:32:20.169862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:32:20.175444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 752/1506] 10.222.0.20 () {58 vars in 1023 bytes} [Mon Jan 10 11:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:32:20.211296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd754a-a4be-47f2-9e10-1a39bb9bfe76 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:20.223493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd754a-a4be-47f2-9e10-1a39bb9bfe76 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:20.228911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef0ec9-67d7-40d5-af53-e78b8be0e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:20.229755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef0ec9-67d7-40d5-af53-e78b8be0e4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:20.237952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef0ec9-67d7-40d5-af53-e78b8be0e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:20.237952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef0ec9-67d7-40d5-af53-e78b8be0e4cb admin admin] PATH_INFO: `/v3/projects/fd70255155e6410bb2d9f4554d34cff0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:20.237952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef0ec9-67d7-40d5-af53-e78b8be0e4cb admin admin] RBAC: Authorizing `identity:get_project(project_id=fd70255155e6410bb2d9f4554d34cff0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:20.237952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef0ec9-67d7-40d5-af53-e78b8be0e4cb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:20.237952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 755/1507] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Jan 10 11:32:20 2022] GET /identity/v3/projects/fd70255155e6410bb2d9f4554d34cff0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:32:20.247196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:32:20.256645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca7924-32cd-451c-b5f8-dc6c04486090 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:32:20.260360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9206f-4859-4f64-b87c-55751dde7e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:32:20.266607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9206f-4859-4f64-b87c-55751dde7e12 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:32:20.266607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9206f-4859-4f64-b87c-55751dde7e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:32:20.266607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9206f-4859-4f64-b87c-55751dde7e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:32:20.270516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9206f-4859-4f64-b87c-55751dde7e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:32:20.272143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9206f-4859-4f64-b87c-55751dde7e12 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:32:20.281613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 753/1508] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:33:50.404642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.405253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.405253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.423342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:33:50.424519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:33:50.432515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 756/1509] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:33:50.442205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.442733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.442864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.460382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:33:50.461594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:33:50.469437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 754/1510] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:33:50.474027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:50.484391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0b989-1c4c-441f-bd1e-cb23e855a782 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:50.488892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:50.489539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.489819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.490095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.490863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:33:50.491169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:50.493438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:50.504753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 757/1511] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:33:50.512901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:50.521888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec70df5-75e1-4283-9852-9f5a37495f27 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:50.526361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:50.527009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.527288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.527580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.528264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:50.530176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:50.646815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 755/1512] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:33:50 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:33:50.651559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:50.661373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c715898-ecae-4aff-8a8c-92ab98dbb178 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:50.714571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:50.715235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.715513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.715789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.716489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:50.718424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:50.829682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 758/1513] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:33:50 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:33:50.833929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:50.844688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8da0d-76c6-4bc0-bad0-1c7a69fc8f6e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:50.849371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:50.850022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.850325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.850599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.851329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:50.853903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:50.866465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 756/1514] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:33:50.870900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:50.880637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634e58-fb95-42da-9885-156cf49424ae admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:50.885260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e530a8-2fb4-438a-85bf-c9d51a0a1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:50.885901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e530a8-2fb4-438a-85bf-c9d51a0a1d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.886181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e530a8-2fb4-438a-85bf-c9d51a0a1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.886490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e530a8-2fb4-438a-85bf-c9d51a0a1d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.887245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e530a8-2fb4-438a-85bf-c9d51a0a1d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:50.888834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e530a8-2fb4-438a-85bf-c9d51a0a1d7b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:50.902833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 759/1515] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:33:50.907146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:50.917767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848e91-087b-4d59-8b7b-3742023198d0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:50.922493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:50.923360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:50.923643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:50.923913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] PATH_INFO: `/v3/projects/c106a152e83f4cc6935062ddbb2e82b6/users/4e87086d66da4569840e6d153d71601e/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:50.938512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c106a152e83f4cc6935062ddbb2e82b6, user_id=4e87086d66da4569840e6d153d71601e, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:50.941173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:51.006457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 757/1516] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:33:50 2022] PUT /identity/v3/projects/c106a152e83f4cc6935062ddbb2e82b6/users/4e87086d66da4569840e6d153d71601e/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:33:51.018308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3e15-4140-492b-9472-5a0575537ebb None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:51.018598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3e15-4140-492b-9472-5a0575537ebb None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:51.018876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3e15-4140-492b-9472-5a0575537ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:51.045914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-445f3e15-4140-492b-9472-5a0575537ebb None None] MFA Rules not processed for user `4e87086d66da4569840e6d153d71601e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:33:51.047138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-445f3e15-4140-492b-9472-5a0575537ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:33:51.108956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 760/1517] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:33:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:33:51.120578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:51.187209 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873227-1f20-4733-97bc-a9027663559e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:51.192978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:51.193628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:51.193912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:51.194190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:51.202950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:51.204550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:51.213710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 758/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:33:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:33:51.282134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc938f-734b-42ad-ab63-69e8f89ff91d None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:51.282613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc938f-734b-42ad-ab63-69e8f89ff91d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:51.282917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc938f-734b-42ad-ab63-69e8f89ff91d None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:51.284669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 761/1519] 10.222.0.20 () {52 vars in 829 bytes} [Mon Jan 10 11:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:33:51.288257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:51.348034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ac37e-8325-4712-9851-fe18831edf67 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:51.352825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:51.354069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:51.354375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:51.354648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] PATH_INFO: `/v3/users/4e87086d66da4569840e6d153d71601e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:51.355832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e87086d66da4569840e6d153d71601e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:51.356849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:33:51.356849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:33:51.356849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:33:51.358044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:51.589962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e87086d66da4569840e6d153d71601e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:51.602023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e87086d66da4569840e6d153d71601e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:51.602859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e87086d66da4569840e6d153d71601e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:51.603447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e87086d66da4569840e6d153d71601e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:51.626655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e87086d66da4569840e6d153d71601e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:51.714666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 759/1520] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:33:51 2022] DELETE /identity/v3/users/4e87086d66da4569840e6d153d71601e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:33:51.718924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:51.719396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:51.719521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:51.737364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:33:51.738634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:33:51.798414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 762/1521] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:33:51.808215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:51.809598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:33:51.865186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80688f-eb24-4170-9dc4-5f1f08cc5142 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:51.869780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540fb95-ad28-42d6-88e9-40a034ac5e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:51.870455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540fb95-ad28-42d6-88e9-40a034ac5e70 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:51.870738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540fb95-ad28-42d6-88e9-40a034ac5e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:51.871020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540fb95-ad28-42d6-88e9-40a034ac5e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:51.879819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540fb95-ad28-42d6-88e9-40a034ac5e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:51.881257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540fb95-ad28-42d6-88e9-40a034ac5e70 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:51.890939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 760/1522] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:33:52.413500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:33:52.415696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:33:52.427156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc91fc-c5ae-4cb5-883a-c6f3aebd9369 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:33:52.431724 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] PATH_INFO: `/v3/projects/c106a152e83f4cc6935062ddbb2e82b6` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c106a152e83f4cc6935062ddbb2e82b6)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:33:52.437174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:33:52.441030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:33:52.611990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c106a152e83f4cc6935062ddbb2e82b6', 'request_id': 'req-4d2be311-d5e0-4885-a8ba-81c54ad985f9'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:52.703827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c106a152e83f4cc6935062ddbb2e82b6', 'request_id': 'req-4d2be311-d5e0-4885-a8ba-81c54ad985f9'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:52.710689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c106a152e83f4cc6935062ddbb2e82b6', 'request_id': 'req-4d2be311-d5e0-4885-a8ba-81c54ad985f9'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:52.729932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] The token cache is being invalidate because project c106a152e83f4cc6935062ddbb2e82b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:33:52.730659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:52.731184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d2be311-d5e0-4885-a8ba-81c54ad985f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:33:52.732705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 763/1523] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:33:52 2022] DELETE /identity/v3/projects/c106a152e83f4cc6935062ddbb2e82b6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:35:25.634314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c65f8-58a3-4263-8fed-304c6e4c02f7 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:25.634848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c65f8-58a3-4263-8fed-304c6e4c02f7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:25.634963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c65f8-58a3-4263-8fed-304c6e4c02f7 None None] PATH_INFO: `/v3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:25.636169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 761/1524] 10.222.0.31 () {54 vars in 925 bytes} [Mon Jan 10 11:35:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:35:25.643142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:25.643613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:25.643715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:25.663073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:25.664273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:25.666479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a67c0-deb9-45d4-871a-b67090b4f90c None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:25.666769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a67c0-deb9-45d4-871a-b67090b4f90c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:25.667046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a67c0-deb9-45d4-871a-b67090b4f90c None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:25.668812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:35:25.673358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798064-3d91-4a28-8f6c-201915dd287b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:25.673644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798064-3d91-4a28-8f6c-201915dd287b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:25.673921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5798064-3d91-4a28-8f6c-201915dd287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:25.691992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c5798064-3d91-4a28-8f6c-201915dd287b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:25.693190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c5798064-3d91-4a28-8f6c-201915dd287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:25.728666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 764/1526] 10.222.0.31 () {58 vars in 1015 bytes} [Mon Jan 10 11:35:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:25.753565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 763/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:35:25.910535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:25.911930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:25.983031 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83f65d-2731-48e8-8250-424ff37a46d2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:25.989033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aebc6-8c4b-44f4-b8af-0ed589d2d3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:25.989682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aebc6-8c4b-44f4-b8af-0ed589d2d3a6 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:25.989964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aebc6-8c4b-44f4-b8af-0ed589d2d3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:25.990261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aebc6-8c4b-44f4-b8af-0ed589d2d3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:25.998650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aebc6-8c4b-44f4-b8af-0ed589d2d3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:26.001044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aebc6-8c4b-44f4-b8af-0ed589d2d3a6 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:26.010540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 765/1528] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:35:27.608228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837337a-5f38-4573-b815-df897525e301 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:27.608764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837337a-5f38-4573-b815-df897525e301 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:27.608764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837337a-5f38-4573-b815-df897525e301 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:27.611740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:27.617232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624ccb0-c99a-4ac1-9607-fa2fb0b2f797 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:27.617743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624ccb0-c99a-4ac1-9607-fa2fb0b2f797 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:27.617852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624ccb0-c99a-4ac1-9607-fa2fb0b2f797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:27.638598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4624ccb0-c99a-4ac1-9607-fa2fb0b2f797 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:27.640271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4624ccb0-c99a-4ac1-9607-fa2fb0b2f797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:27.649476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:27.815811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837337a-5f38-4573-b815-df897525e301 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:27.830428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837337a-5f38-4573-b815-df897525e301 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:27.835884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c503f-2c7c-4019-b770-f78dc28628fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:27.836510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c503f-2c7c-4019-b770-f78dc28628fc service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:27.836791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c503f-2c7c-4019-b770-f78dc28628fc service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:27.837070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c503f-2c7c-4019-b770-f78dc28628fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:27.845645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c503f-2c7c-4019-b770-f78dc28628fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:27.847286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c503f-2c7c-4019-b770-f78dc28628fc service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:27.856927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 765/1531] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:35:29.525675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b99de-c416-4133-9147-41b2db49d24b None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:29.526206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b99de-c416-4133-9147-41b2db49d24b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:29.526206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b99de-c416-4133-9147-41b2db49d24b None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:29.528007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 767/1532] 10.222.0.20 () {54 vars in 960 bytes} [Mon Jan 10 11:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:29.533938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c43d9-3d33-4f12-883c-f811793bee49 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:29.534406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c43d9-3d33-4f12-883c-f811793bee49 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:29.534528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c43d9-3d33-4f12-883c-f811793bee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:29.552756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e28c43d9-3d33-4f12-883c-f811793bee49 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:29.553969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e28c43d9-3d33-4f12-883c-f811793bee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:29.562639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 766/1533] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Jan 10 11:35:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:29.569843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b99de-c416-4133-9147-41b2db49d24b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:29.583020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b99de-c416-4133-9147-41b2db49d24b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:29.588212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb76574-f4c6-4e5d-bd63-92bad2116332 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:29.588889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76574-f4c6-4e5d-bd63-92bad2116332 service placement] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:29.589187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76574-f4c6-4e5d-bd63-92bad2116332 service placement] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:29.589456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb76574-f4c6-4e5d-bd63-92bad2116332 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:29.600022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb76574-f4c6-4e5d-bd63-92bad2116332 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:29.600553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb76574-f4c6-4e5d-bd63-92bad2116332 service placement] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:29.610839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 768/1534] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:35:39.871957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d890-8da8-4ced-bbcf-2bb1695b9ed7 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:39.872485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d890-8da8-4ced-bbcf-2bb1695b9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:39.872485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d890-8da8-4ced-bbcf-2bb1695b9ed7 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:39.874187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:39.879099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0326-7aa3-448b-b2cd-6cc85cd68d35 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:39.879558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0326-7aa3-448b-b2cd-6cc85cd68d35 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:39.879665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc0326-7aa3-448b-b2cd-6cc85cd68d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:39.899559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e7fc0326-7aa3-448b-b2cd-6cc85cd68d35 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:39.900764 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e7fc0326-7aa3-448b-b2cd-6cc85cd68d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:39.908728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:40.075291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d890-8da8-4ced-bbcf-2bb1695b9ed7 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:40.089750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d890-8da8-4ced-bbcf-2bb1695b9ed7 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:40.095102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc8e3-d7e0-4578-828c-f27e4e825363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:40.095721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc8e3-d7e0-4578-828c-f27e4e825363 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:40.096001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc8e3-d7e0-4578-828c-f27e4e825363 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:40.096273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc8e3-d7e0-4578-828c-f27e4e825363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:40.105050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc8e3-d7e0-4578-828c-f27e4e825363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:40.106689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc8e3-d7e0-4578-828c-f27e4e825363 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:40.116760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 768/1537] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:35:41.680054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd6ae2-094c-4949-b6f9-6492eab53687 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:41.680617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd6ae2-094c-4949-b6f9-6492eab53687 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:41.680702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd6ae2-094c-4949-b6f9-6492eab53687 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:41.682488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 770/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 11:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:41.687514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c12104-17a2-4b31-a1c8-ebbc52331723 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:41.687981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c12104-17a2-4b31-a1c8-ebbc52331723 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:41.688224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c12104-17a2-4b31-a1c8-ebbc52331723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:41.706753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-00c12104-17a2-4b31-a1c8-ebbc52331723 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:41.709168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-00c12104-17a2-4b31-a1c8-ebbc52331723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:41.717281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 769/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 11:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:41.871651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd6ae2-094c-4949-b6f9-6492eab53687 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:41.886502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd6ae2-094c-4949-b6f9-6492eab53687 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:41.891830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de5725-a2a8-4b12-b2a3-76a799f68d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:41.892456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de5725-a2a8-4b12-b2a3-76a799f68d45 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:41.892731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de5725-a2a8-4b12-b2a3-76a799f68d45 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:41.893002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de5725-a2a8-4b12-b2a3-76a799f68d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:41.901868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de5725-a2a8-4b12-b2a3-76a799f68d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:41.903482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de5725-a2a8-4b12-b2a3-76a799f68d45 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:41.914077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 771/1540] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:35:46.513002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b93813-c217-4103-b8c4-65125697d735 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:46.513537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b93813-c217-4103-b8c4-65125697d735 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:46.513636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b93813-c217-4103-b8c4-65125697d735 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:46.515431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 770/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:46.520714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8df9d-dd8f-494d-86c3-642823fd8cb1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:46.521115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8df9d-dd8f-494d-86c3-642823fd8cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:46.521257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8df9d-dd8f-494d-86c3-642823fd8cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:46.539539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-99a8df9d-dd8f-494d-86c3-642823fd8cb1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:46.540719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-99a8df9d-dd8f-494d-86c3-642823fd8cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:46.548346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 772/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:46.585656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b93813-c217-4103-b8c4-65125697d735 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:46.587401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-76b93813-c217-4103-b8c4-65125697d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:46.641785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b93813-c217-4103-b8c4-65125697d735 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:46.645288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9cfa9-8a10-48af-ba5a-de0017af96fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:46.645916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9cfa9-8a10-48af-ba5a-de0017af96fe service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:46.646198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9cfa9-8a10-48af-ba5a-de0017af96fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:46.646498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9cfa9-8a10-48af-ba5a-de0017af96fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:46.660829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9cfa9-8a10-48af-ba5a-de0017af96fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:46.662313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9cfa9-8a10-48af-ba5a-de0017af96fe service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:46.672519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 771/1543] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:35:49.105137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7dae-2a0c-440c-978e-fcaa5d06f1b1 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:49.105714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7dae-2a0c-440c-978e-fcaa5d06f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:49.105714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7dae-2a0c-440c-978e-fcaa5d06f1b1 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:49.107495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 773/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:49.112547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599adeda-6a71-46e8-b02b-7823aaccaa34 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:49.112949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599adeda-6a71-46e8-b02b-7823aaccaa34 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:49.113104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599adeda-6a71-46e8-b02b-7823aaccaa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:49.131935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-599adeda-6a71-46e8-b02b-7823aaccaa34 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:49.133200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-599adeda-6a71-46e8-b02b-7823aaccaa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:49.141194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 772/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:49.179172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7dae-2a0c-440c-978e-fcaa5d06f1b1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:49.189605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7dae-2a0c-440c-978e-fcaa5d06f1b1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:49.193059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdede43-6260-4385-adfb-e204f5d539d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:49.193672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdede43-6260-4385-adfb-e204f5d539d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:49.194599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdede43-6260-4385-adfb-e204f5d539d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:49.194919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdede43-6260-4385-adfb-e204f5d539d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:49.203678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdede43-6260-4385-adfb-e204f5d539d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:49.205113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdede43-6260-4385-adfb-e204f5d539d5 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:49.214312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 774/1546] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:35:53.226445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dbebe-1d04-4e10-a997-d3c29919da4a None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:53.227030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dbebe-1d04-4e10-a997-d3c29919da4a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:53.227030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dbebe-1d04-4e10-a997-d3c29919da4a None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:53.229053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 773/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:35:53.234362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd75e1-c110-4766-8ea3-938c36d5c828 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:53.234795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd75e1-c110-4766-8ea3-938c36d5c828 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:53.237266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd75e1-c110-4766-8ea3-938c36d5c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:53.253276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a7dd75e1-c110-4766-8ea3-938c36d5c828 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:53.254495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a7dd75e1-c110-4766-8ea3-938c36d5c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:53.262173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 775/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:53.313309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dbebe-1d04-4e10-a997-d3c29919da4a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:53.315042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d05dbebe-1d04-4e10-a997-d3c29919da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:53.375632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dbebe-1d04-4e10-a997-d3c29919da4a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:53.379209 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f480e5-f2a8-4b42-a36a-6377c2a27167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:53.379845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f480e5-f2a8-4b42-a36a-6377c2a27167 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:53.380128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f480e5-f2a8-4b42-a36a-6377c2a27167 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:53.380403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f480e5-f2a8-4b42-a36a-6377c2a27167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:53.389627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f480e5-f2a8-4b42-a36a-6377c2a27167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:53.391091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f480e5-f2a8-4b42-a36a-6377c2a27167 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:53.400523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 774/1549] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:35:55.945749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e212-83c3-4739-a1ee-a85a92620bb7 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:55.946330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e212-83c3-4739-a1ee-a85a92620bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:55.946592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e212-83c3-4739-a1ee-a85a92620bb7 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:55.949911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 776/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 11:35:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:55.955336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f1a6-d3a2-41e2-8cc0-4b5d4305dc90 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:55.955851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f1a6-d3a2-41e2-8cc0-4b5d4305dc90 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:55.955963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316f1a6-d3a2-41e2-8cc0-4b5d4305dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:55.981087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2316f1a6-d3a2-41e2-8cc0-4b5d4305dc90 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:55.982331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2316f1a6-d3a2-41e2-8cc0-4b5d4305dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:55.990186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 775/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 11:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:35:56.041815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb59bc-8f5e-4cec-b3ff-feaef4f2fbc9 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:56.042095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb59bc-8f5e-4cec-b3ff-feaef4f2fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:56.042405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb59bc-8f5e-4cec-b3ff-feaef4f2fbc9 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:56.044205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 777/1552] 10.222.0.20 () {54 vars in 963 bytes} [Mon Jan 10 11:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:35:56.049038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0192-401a-4d44-812d-dc1e45c3f197 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:56.049303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0192-401a-4d44-812d-dc1e45c3f197 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:56.049585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b0192-401a-4d44-812d-dc1e45c3f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:56.069628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-916b0192-401a-4d44-812d-dc1e45c3f197 None None] MFA Rules not processed for user `a04d0effd2d54f28af90ede3c495a368`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:35:56.070952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-916b0192-401a-4d44-812d-dc1e45c3f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:35:56.077794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 776/1553] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Jan 10 11:35:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:35:56.085787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb59bc-8f5e-4cec-b3ff-feaef4f2fbc9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:35:56.096333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb59bc-8f5e-4cec-b3ff-feaef4f2fbc9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:35:56.099836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0935fc1-80cb-40af-be2d-194481411d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:35:56.100601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0935fc1-80cb-40af-be2d-194481411d71 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:35:56.100921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0935fc1-80cb-40af-be2d-194481411d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:35:56.101198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0935fc1-80cb-40af-be2d-194481411d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:35:56.113202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0935fc1-80cb-40af-be2d-194481411d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:35:56.114679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0935fc1-80cb-40af-be2d-194481411d71 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:35:56.124743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 778/1554] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:37:20.711029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:20.711645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:20.711645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:20.745165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:20.750057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:20.774719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 777/1555] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:20.784418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:20.785000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:20.785000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:20.816251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:20.818476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:20.829897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 779/1556] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:37:20.836521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:20.863769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f7f64-6489-47e5-a8ef-361df5677c30 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:20.878527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:20.879643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:20.880648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:20.881110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:20.882588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:20.883143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:20.886341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:20.915866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 778/1557] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:20.925517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:20.940284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900f97c-3641-4911-97ee-3155a5bebc13 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:20.945637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf1ecb-5ed5-4bfe-8331-982ff39c8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:20.946405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1ecb-5ed5-4bfe-8331-982ff39c8c9a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:20.946689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1ecb-5ed5-4bfe-8331-982ff39c8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:20.947029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf1ecb-5ed5-4bfe-8331-982ff39c8c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:20.947752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1ecb-5ed5-4bfe-8331-982ff39c8c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:20.949692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf1ecb-5ed5-4bfe-8331-982ff39c8c9a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.118682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 780/1558] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:20 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:37:21.125088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.139802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec89a1-a824-422d-a947-695c5c7379d8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.160365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bf29-7ca3-40c8-80da-78708ed2e2f8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.160707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bf29-7ca3-40c8-80da-78708ed2e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.160920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52bf29-7ca3-40c8-80da-78708ed2e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.196752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7e52bf29-7ca3-40c8-80da-78708ed2e2f8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:21.198061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7e52bf29-7ca3-40c8-80da-78708ed2e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:21.226378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.228389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.228389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.228612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.229356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.231861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.347986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 781/1559] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:21.357930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.358287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.358514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.380675 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 779/1560] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:21.387303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:21.391066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:21.391187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.399142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 782/1561] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:21.403868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.408879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488c13d-a026-4173-93f2-fe12ab061016 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.414152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960ace-5b52-45b0-9684-d2e72a90bb32 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.418464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.419330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.419731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.420246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.421018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.422792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.429610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:21.432396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.433497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.440270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 780/1562] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:37:21.446110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.455283 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 783/1563] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:37:21.462146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b8ee9-5030-4f5a-97cb-651b865105bc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.467273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.472977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.473665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.473950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.474331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.475123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.476869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.490459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f177a1-f562-4f1a-9e05-805c0eb00ca4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.496561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 781/1564] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:21.500699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.509280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c518000-a459-4c72-aac7-313c6d64476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.509854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c518000-a459-4c72-aac7-313c6d64476c admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.514241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c518000-a459-4c72-aac7-313c6d64476c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.514241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c518000-a459-4c72-aac7-313c6d64476c admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.514241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c518000-a459-4c72-aac7-313c6d64476c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.514241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c518000-a459-4c72-aac7-313c6d64476c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.520698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea70d1-bfc4-48d8-b474-f1ae75134ccd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.530915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.532260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.532766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.533260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] PATH_INFO: `/v3/projects/1c300abbfb3b48dab6c40f20c7eb9cd1/users/b6431c85b6c74608aae42e0e856d1a6d/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.559863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c300abbfb3b48dab6c40f20c7eb9cd1, user_id=b6431c85b6c74608aae42e0e856d1a6d, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.563040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.633163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 784/1565] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:21.641096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1aa8-bfdd-4fce-8b26-d3c6e456e632 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.641096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1aa8-bfdd-4fce-8b26-d3c6e456e632 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.641096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1aa8-bfdd-4fce-8b26-d3c6e456e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.667542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9d0b1aa8-bfdd-4fce-8b26-d3c6e456e632 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:21.668993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9d0b1aa8-bfdd-4fce-8b26-d3c6e456e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:21.690243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 782/1566] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:21 2022] PUT /identity/v3/projects/1c300abbfb3b48dab6c40f20c7eb9cd1/users/b6431c85b6c74608aae42e0e856d1a6d/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:21.690243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:21.762912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 785/1567] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:21.764574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bbc8a-a78c-4fe9-967c-f5f07146ceb8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.765125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bbc8a-a78c-4fe9-967c-f5f07146ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.765560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bbc8a-a78c-4fe9-967c-f5f07146ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.802242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f06bbc8a-a78c-4fe9-967c-f5f07146ceb8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:21.805177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f06bbc8a-a78c-4fe9-967c-f5f07146ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:21.828819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb611f2-a0ae-4300-92b4-2ecd7360bbc1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:21.836155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5572cbf-5aaa-4c18-ab74-3260fab244f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:21.836660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572cbf-5aaa-4c18-ab74-3260fab244f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.836944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572cbf-5aaa-4c18-ab74-3260fab244f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.837214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572cbf-5aaa-4c18-ab74-3260fab244f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.837934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5572cbf-5aaa-4c18-ab74-3260fab244f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:21.839943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5572cbf-5aaa-4c18-ab74-3260fab244f6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:21.894346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 786/1568] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:21.896095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092a1b-3afb-4d08-9d50-a8ffc022f6d3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.896654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092a1b-3afb-4d08-9d50-a8ffc022f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.897997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092a1b-3afb-4d08-9d50-a8ffc022f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.920477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-be092a1b-3afb-4d08-9d50-a8ffc022f6d3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:21.922025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-be092a1b-3afb-4d08-9d50-a8ffc022f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:21.930942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 787/1569] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:21.932706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0cae0-77d7-49dc-b636-9f9d4b810f03 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.933201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0cae0-77d7-49dc-b636-9f9d4b810f03 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.933690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0cae0-77d7-49dc-b636-9f9d4b810f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:21.964270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-87c0cae0-77d7-49dc-b636-9f9d4b810f03 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:21.966376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-87c0cae0-77d7-49dc-b636-9f9d4b810f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:21.980598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 788/1570] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:21.982940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428490d-2c3d-4843-b0e9-6c87ad28fcc4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:21.983573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428490d-2c3d-4843-b0e9-6c87ad28fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:21.983928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428490d-2c3d-4843-b0e9-6c87ad28fcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.003586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 783/1571] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:22.015632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f197-9b77-4900-bcec-f11840816028 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.015632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f197-9b77-4900-bcec-f11840816028 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.015632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83f197-9b77-4900-bcec-f11840816028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.019478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8428490d-2c3d-4843-b0e9-6c87ad28fcc4 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.021550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8428490d-2c3d-4843-b0e9-6c87ad28fcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.041057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 789/1572] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.041057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.041057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.041057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.044991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-bc83f197-9b77-4900-bcec-f11840816028 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.047142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-bc83f197-9b77-4900-bcec-f11840816028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.062354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 784/1573] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.064622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca799f7-ba3a-4ae3-9c4a-1dfc3db3807b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.065184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca799f7-ba3a-4ae3-9c4a-1dfc3db3807b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.065609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca799f7-ba3a-4ae3-9c4a-1dfc3db3807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.072252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.074548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.085791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 790/1574] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.088034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.102029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9ca799f7-ba3a-4ae3-9c4a-1dfc3db3807b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.104140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9ca799f7-ba3a-4ae3-9c4a-1dfc3db3807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.119396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 785/1575] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.121730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.122251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.122759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.160196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.161960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.174831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 786/1576] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.177262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.181707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0603d-6383-412d-9dcb-ce5d8c168338 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.187267 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.188150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.188544 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.189017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.194060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6fea0-ce45-49a9-a738-3adf0778251a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.201337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b835-4e85-4697-b6dc-13d01e204edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.202374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b835-4e85-4697-b6dc-13d01e204edc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.202836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b835-4e85-4697-b6dc-13d01e204edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.203280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b835-4e85-4697-b6dc-13d01e204edc admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.204500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b835-4e85-4697-b6dc-13d01e204edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.205001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.207323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b835-4e85-4697-b6dc-13d01e204edc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.207497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.223309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 791/1577] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:22.224666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.230386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 787/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:22.230386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e3d9-8cfd-4cae-abeb-e7b25e572a5b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.230386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e3d9-8cfd-4cae-abeb-e7b25e572a5b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.230386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8e3d9-8cfd-4cae-abeb-e7b25e572a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.241903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5f66-d0ef-484c-a9d4-4918c7a203ef service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.247263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.248157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.248523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.248917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.249870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:22.250334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.252361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.271930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 792/1579] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:22.274689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.274861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-57f8e3d9-8cfd-4cae-abeb-e7b25e572a5b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.276439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-57f8e3d9-8cfd-4cae-abeb-e7b25e572a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.290316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d323b2a-1ea3-4980-bfca-780e37a6b944 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.290605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 788/1580] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.295749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.296284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.296808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.298421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.299315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.299661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.300051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.301299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:22.301759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.304564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83657a8c-02ac-47fc-992d-2246a5dc35c5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.320287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 793/1581] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:22.320581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.322436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745537a-9180-4a3e-a220-74d26451609a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.322916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745537a-9180-4a3e-a220-74d26451609a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.323383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745537a-9180-4a3e-a220-74d26451609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.323633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.336447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 789/1582] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.338440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.352560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3745537a-9180-4a3e-a220-74d26451609a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.353732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193451-21f8-42eb-9ca3-6b08767729b8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.354566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3745537a-9180-4a3e-a220-74d26451609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.361319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.362403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.366507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.366507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.366507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:22.366507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.368359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 794/1583] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.368545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.369713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745537a-9180-4a3e-a220-74d26451609a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.390443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745537a-9180-4a3e-a220-74d26451609a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.393765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 790/1584] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:22.394814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.399784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.400984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.401464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.401926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.403401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.407129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb27934-85f2-41ce-a796-b6300319441e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.407394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.416026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.416783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.417256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.417727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.419129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.427126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.427418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 795/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:22.427418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.440104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a0b9d-5d91-48e6-8ae5-c2b3539b5d5a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.447215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.448082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.448499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.448889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.449985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:22.450515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.452729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.487973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 796/1586] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:22.489208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.502958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2cb5a-75cc-47e3-a50f-892c2a7372f1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.509839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.510742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.511133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.511511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.512360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.514598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.581759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 791/1587] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:22.583371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.657269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88c531-54e4-4435-9066-d90423330a8d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.664379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.665301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.665630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.665996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.667114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:22.671694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.671694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841cfbb-554b-48a5-a216-ec9f0a8a2a15 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.694727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 792/1588] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:22.696871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.697483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.697786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.733139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:22.735193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:22.739733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 797/1589] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/projects => generated 371 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:22.740692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.812844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268c78-da07-48dd-bd7d-d6e54cc05ff6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.820060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.820957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.821331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.821778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.822665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.824874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:22.825709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 793/1590] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:22.826576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:22.843566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49c8c0-715f-4b8b-bb97-1e0f0a53384f None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:22.849110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:22.850866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:22.851299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:22.851700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] PATH_INFO: `/v3/projects/274889e6213c4dfaab0997e2dad420ff/users/2c652557dbd54165a3498c08b2dd5673/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:22.876121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274889e6213c4dfaab0997e2dad420ff, user_id=2c652557dbd54165a3498c08b2dd5673, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:22.884716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.024493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 798/1591] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:22 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:23.029902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.047160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 794/1592] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:22 2022] PUT /identity/v3/projects/274889e6213c4dfaab0997e2dad420ff/users/2c652557dbd54165a3498c08b2dd5673/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:23.049280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.128655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cce4a1-0b7a-4bc2-bbf0-4609a7070475 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.150026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f02e7d-3a9f-4129-b60f-ee938d2625a6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.157665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.158790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.159240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.159848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.160789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.165156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.212549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.213112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.213402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.213679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.214444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.216446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.365766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 799/1593] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/projects => generated 377 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:23.365766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.454071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1e771-b56d-4036-8fb4-86c82010479a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.458953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.460326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.460687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.460961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.461668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.463726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.493946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 795/1594] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/users => generated 296 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:23.495480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.511025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3b3f7-3cee-4594-ac6c-5c1bfea39ee5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.515942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.516644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.516928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.517204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.517920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.519938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.662333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 800/1595] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/projects => generated 371 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:23.668294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.669541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 796/1596] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:23.671864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.691382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd7d1a-f7d9-46f3-a681-058ac9575648 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.774353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8a4eb-fc3c-4a1d-836e-61f4c5eef09b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.779077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.779755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.780037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.780318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.780943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.781147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.781704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.782050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.782423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.782998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.783356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:23.783755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.785551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cab2b-5a4a-4496-9585-b8442b344699 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.801469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 801/1597] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:23.804008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.804431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.804785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.826202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:23.827456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:23.836887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 802/1598] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:23.838400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.851929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96d5d1-f796-4d04-97ec-8317118d24e2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.859026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.859026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.859026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.859026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.859600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.861179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.895146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 797/1599] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:23.899915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.910319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b649f98-8a0a-4bc0-928a-c6ce54bbb428 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.917975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.919120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.919606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.920081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.921404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.924345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:23.947550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 798/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:23.947550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:23.965553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c11d7-aebb-4302-baff-550df71b688d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:23.973955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:23.980295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:23.980295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:23.980295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:23.980295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:23.982528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.021234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 803/1601] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:24.023130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.033653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996ad8-923a-4eb9-a5b0-bfd53be842b9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.039118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.042390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.042390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.042390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.042390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.043047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.055122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 804/1602] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.056758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.067702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38473ec1-1f8d-49ed-845a-f87fb03e0e2d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.074574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.075380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.075762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.076157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.076959 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.080822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.154249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 799/1603] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:23 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:24.155362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.227006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a31dac-0889-4728-9e36-bb0d369d2c4e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.231499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.232192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.232583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.233006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.244172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.245634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.255781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 800/1604] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:24.257308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.268591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827988c5-a18e-4b26-a05b-3792bad9171f service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.275507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.276347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.276791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.277167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.278024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.279802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.297122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 801/1605] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.297646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.312048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fb519-601b-4f61-8c5f-78e053645949 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.317595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.318323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.318595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.319471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.320672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.322396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.333141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 802/1606] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.334014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.344730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976ba2b-2853-4a6f-bcaf-591e900a9f83 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.350019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e0ac-ef69-4dc9-b1aa-33891d25ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.351123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e0ac-ef69-4dc9-b1aa-33891d25ea69 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.351511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e0ac-ef69-4dc9-b1aa-33891d25ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.351876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e0ac-ef69-4dc9-b1aa-33891d25ea69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.352736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e0ac-ef69-4dc9-b1aa-33891d25ea69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.355442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e0ac-ef69-4dc9-b1aa-33891d25ea69 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.366187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 805/1607] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:24 2022] POST /identity/v3/projects => generated 373 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:24.368422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.378147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 803/1608] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.378147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.378147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.378147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.417221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] MFA Rules not processed for user `b6431c85b6c74608aae42e0e856d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:24.417906 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:24.454405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813aa40-a60b-4c40-b3de-20877c041102 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.461989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.463116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.463576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.464025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.464963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.467901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.485501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 806/1609] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.487201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.508736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a77d5-ed1f-46cf-b921-e4bc6b4a0274 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.519539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.520629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.521090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.521627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.523660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.527907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.536832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 804/1610] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:24.539330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.552884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 807/1611] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.555375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.559244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191edcf9-7694-49dd-80a0-9a95cbdace96 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.567396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.568550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.569640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.570140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.574044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.575367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.587065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc964-23f4-4b13-b80b-33820aba4c16 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.596817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 805/1612] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.598043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.599033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.601855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.602360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.602837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] PATH_INFO: `/v3/projects/a77ddb5f1ea14e54be79c194a288b5a7/users/14216d42be0e4e1690f9a77a09e25967/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.612696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e65bee-e230-4e02-bed9-9abad003c889 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.618927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.620138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.620138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.620372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.621056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.623062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.632627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77ddb5f1ea14e54be79c194a288b5a7, user_id=14216d42be0e4e1690f9a77a09e25967, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.637924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.752136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 806/1613] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:24 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:24.753239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.769502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a5922-4148-4b3b-a32c-584a562d7905 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.776754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.778025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.778204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.778623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.779793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.782470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.800874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 807/1614] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.802156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.815700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 808/1615] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:24 2022] PUT /identity/v3/projects/a77ddb5f1ea14e54be79c194a288b5a7/users/14216d42be0e4e1690f9a77a09e25967/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:24.819460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b8538-986c-4293-928f-34ae7222b6fe admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.820952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:24.893043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.893984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.894299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.894610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] PATH_INFO: `/v3/projects/23cef35cb33443858942522019b51ea9/users/02c8aa90fc124ff2933e46c9166d5f3e/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.913918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23cef35cb33443858942522019b51ea9, user_id=02c8aa90fc124ff2933e46c9166d5f3e, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.917227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.917708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a40c84-3283-4b23-9d9f-f7d1bffc658a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:24.924081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f2af3-7268-47e8-99ae-1adaded6dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:24.925326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2af3-7268-47e8-99ae-1adaded6dd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.926001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2af3-7268-47e8-99ae-1adaded6dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.926585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f2af3-7268-47e8-99ae-1adaded6dd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.927662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2af3-7268-47e8-99ae-1adaded6dd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:24.930079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f2af3-7268-47e8-99ae-1adaded6dd98 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:24.942453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 809/1616] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:24.942453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:24.942453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:24.942453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:24.965672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] MFA Rules not processed for user `b6431c85b6c74608aae42e0e856d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:24.967036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:25.032789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 810/1617] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:25.034325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.053060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb42a1-d853-4d7f-aaeb-ca5e60038ae5 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.055049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 808/1618] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:24 2022] PUT /identity/v3/projects/23cef35cb33443858942522019b51ea9/users/02c8aa90fc124ff2933e46c9166d5f3e/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:25.066343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.138332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545afed-9c96-420e-a7c7-ff28faeec7e4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.139414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.140477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.140835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.141180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] PATH_INFO: `/v3/projects/f8635cce808f4b1c9e754fe407a2f60b/users/0a3ea138daa84701bbf756e1ec43fb4c/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.146312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.147679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.148290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.148577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.149352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.151037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:25.161930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8635cce808f4b1c9e754fe407a2f60b, user_id=0a3ea138daa84701bbf756e1ec43fb4c, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.163090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 809/1619] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:25.164422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.165654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:25.174988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549bfa8-22fd-4a19-ba63-fdb8aa49f174 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.180866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ad7d7-70e0-4c1d-99b9-5553c0573a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.181755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ad7d7-70e0-4c1d-99b9-5553c0573a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.182043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ad7d7-70e0-4c1d-99b9-5553c0573a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.182346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ad7d7-70e0-4c1d-99b9-5553c0573a89 admin admin] PATH_INFO: `/v3/projects/dd16126432b64642b65fa0a3d8bd7043/users/8fa7971d6f99464bbe62c60e318cf414/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.198404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ad7d7-70e0-4c1d-99b9-5553c0573a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd16126432b64642b65fa0a3d8bd7043, user_id=8fa7971d6f99464bbe62c60e318cf414, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.201409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ad7d7-70e0-4c1d-99b9-5553c0573a89 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:25.401149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 810/1620] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:25 2022] PUT /identity/v3/projects/dd16126432b64642b65fa0a3d8bd7043/users/8fa7971d6f99464bbe62c60e318cf414/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:25.403956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f368e8-58ef-46b1-973a-8cdbdcd0463e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.404743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f368e8-58ef-46b1-973a-8cdbdcd0463e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.405758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f368e8-58ef-46b1-973a-8cdbdcd0463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.407404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 811/1621] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:25 2022] PUT /identity/v3/projects/f8635cce808f4b1c9e754fe407a2f60b/users/0a3ea138daa84701bbf756e1ec43fb4c/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:25.409047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.438273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c5f368e8-58ef-46b1-973a-8cdbdcd0463e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:25.439802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c5f368e8-58ef-46b1-973a-8cdbdcd0463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:25.484665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4083d65-75fd-4214-8ec1-d8058811e7ce admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.518035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 811/1622] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:25.518035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603156-43f6-4379-a521-fab3531c9e16 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.518035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603156-43f6-4379-a521-fab3531c9e16 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.518035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603156-43f6-4379-a521-fab3531c9e16 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.518035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 812/1623] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jan 10 11:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:25.518859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.519380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.519661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.552216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] MFA Rules not processed for user `02c8aa90fc124ff2933e46c9166d5f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:25.554660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:25.588720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.591954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.592796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.594623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] PATH_INFO: `/v3/projects/0384f08acae8463ca10014602323f6d5/users/160bbca382424370839263f594fe964d/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.613290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0384f08acae8463ca10014602323f6d5, user_id=160bbca382424370839263f594fe964d, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.616814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:25.633339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 813/1624] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:25.634601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.646260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771e70-a968-46b0-ade3-94a9da2450bf None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.652619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66e8a-37d0-4bb9-bc7c-d9e5155f88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.653333 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66e8a-37d0-4bb9-bc7c-d9e5155f88d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.653615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66e8a-37d0-4bb9-bc7c-d9e5155f88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.653887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66e8a-37d0-4bb9-bc7c-d9e5155f88d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.654778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a66e8a-37d0-4bb9-bc7c-d9e5155f88d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.657138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a66e8a-37d0-4bb9-bc7c-d9e5155f88d0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:25.668803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 814/1625] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:25.672467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155608de-71d9-43b4-90fd-96e5f918da52 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.672467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155608de-71d9-43b4-90fd-96e5f918da52 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.672467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155608de-71d9-43b4-90fd-96e5f918da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.689931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-155608de-71d9-43b4-90fd-96e5f918da52 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:25.691189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-155608de-71d9-43b4-90fd-96e5f918da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:25.699545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 815/1626] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:25.700832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463784-8587-41d7-9020-0a260ace6464 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.701110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463784-8587-41d7-9020-0a260ace6464 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.701379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463784-8587-41d7-9020-0a260ace6464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.724069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b1463784-8587-41d7-9020-0a260ace6464 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:25.725925 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b1463784-8587-41d7-9020-0a260ace6464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:25.734567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 816/1627] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:25.735900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.736193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.736474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.751963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 812/1628] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:25 2022] PUT /identity/v3/projects/0384f08acae8463ca10014602323f6d5/users/160bbca382424370839263f594fe964d/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:25.758571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.759988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:25.761913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:25.818173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a146-34bf-46c9-8d25-508d359d24ff admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.822720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.823758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.824199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.824638 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.860997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 817/1629] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jan 10 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:25.862879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.916155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.919463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:25.939763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 813/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:25.941016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:25.963000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5df59-9003-40be-85df-6b4214d7a361 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.970546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d5f02-c160-4db8-b42c-0a4de339dd27 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:25.971875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.972716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:25.973038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.973469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.973948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.974536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:25.975387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:25.975741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:25.976363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] PATH_INFO: `/v3/projects/9266798caa6b4b9b9bb1e690659b268f/users/315f06b898ff41ddaa5868bc9a718582/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:25.980789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.009263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9266798caa6b4b9b9bb1e690659b268f, user_id=315f06b898ff41ddaa5868bc9a718582, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.014712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.154359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 814/1631] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:25 2022] PUT /identity/v3/projects/9266798caa6b4b9b9bb1e690659b268f/users/315f06b898ff41ddaa5868bc9a718582/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:26.154359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.154811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 818/1632] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:25 2022] POST /identity/v3/projects => generated 371 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:26.154811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.229662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458e04a-2118-4436-b107-bc8789103f5f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.243477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da6ae-9dcd-459d-9bba-e1fa81d78192 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.248085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637ccd-3b19-48d1-873d-d374e012882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.248782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637ccd-3b19-48d1-873d-d374e012882c service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.249078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637ccd-3b19-48d1-873d-d374e012882c service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.249395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637ccd-3b19-48d1-873d-d374e012882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.317188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.317941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.318284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.318559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.328397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637ccd-3b19-48d1-873d-d374e012882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.331289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637ccd-3b19-48d1-873d-d374e012882c service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.335325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.338349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.352423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 819/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:26.355141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eed564-921e-4418-8f95-50e91922abed None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.355652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eed564-921e-4418-8f95-50e91922abed None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.356590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eed564-921e-4418-8f95-50e91922abed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.358766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 815/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:26.360257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.402249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-10eed564-921e-4418-8f95-50e91922abed None None] MFA Rules not processed for user `160bbca382424370839263f594fe964d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:26.415347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-10eed564-921e-4418-8f95-50e91922abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:26.514398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f132-a9c6-4740-827a-f77a2f917f1c service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.543769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0b81c-59ab-4fe3-9489-4c9a88c26a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.550236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b81c-59ab-4fe3-9489-4c9a88c26a9c service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.550236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b81c-59ab-4fe3-9489-4c9a88c26a9c service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.550236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0b81c-59ab-4fe3-9489-4c9a88c26a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.551499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 820/1635] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:26.553047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eed564-921e-4418-8f95-50e91922abed None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.572005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eed564-921e-4418-8f95-50e91922abed None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.580100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.581260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.582080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.582523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.583815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.589576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.681304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0b81c-59ab-4fe3-9489-4c9a88c26a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.683963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0b81c-59ab-4fe3-9489-4c9a88c26a9c service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.698576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 816/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:26.699667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.699964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.700237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.743567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] MFA Rules not processed for user `315f06b898ff41ddaa5868bc9a718582`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:26.743567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:26.799387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 821/1637] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:26 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:26.801461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.822793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119fa7d-06d0-4cf1-a9ee-74285655c5e1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.829010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 817/1638] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:26.843617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.843859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56314-0c7d-403f-b760-6c10b326d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.844749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47205c44-5152-4d20-9435-548946aae2c4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.847204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56314-0c7d-403f-b760-6c10b326d30d admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.848490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56314-0c7d-403f-b760-6c10b326d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.849384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56314-0c7d-403f-b760-6c10b326d30d admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.851125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6ca2b-e47d-452f-af39-3582e3795b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.851898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ca2b-e47d-452f-af39-3582e3795b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.852514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ca2b-e47d-452f-af39-3582e3795b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.852889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ca2b-e47d-452f-af39-3582e3795b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.853837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ca2b-e47d-452f-af39-3582e3795b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.854150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56314-0c7d-403f-b760-6c10b326d30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.856129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ca2b-e47d-452f-af39-3582e3795b30 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.859526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56314-0c7d-403f-b760-6c10b326d30d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:26.873343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 818/1639] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:26.876400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee96a-a44f-465c-a35d-6e4c5ebb4783 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.877644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee96a-a44f-465c-a35d-6e4c5ebb4783 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.878375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee96a-a44f-465c-a35d-6e4c5ebb4783 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.883945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 819/1640] 10.222.0.20 () {54 vars in 961 bytes} [Mon Jan 10 11:37:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:26.885775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee96a-a44f-465c-a35d-6e4c5ebb4783 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:26.923411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee96a-a44f-465c-a35d-6e4c5ebb4783 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:26.945687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:26.947439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:26.948012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:26.949389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] PATH_INFO: `/v3/projects/9f8d6323a6bd4739a1c866f2e164934f/users/29bd67fd9ac64f57acbf9d9492731655/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:26.978100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8d6323a6bd4739a1c866f2e164934f, user_id=29bd67fd9ac64f57acbf9d9492731655, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:26.984056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:27.051809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 822/1641] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:26 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:27.061039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.061039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.061529 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.132318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 820/1642] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:26 2022] PUT /identity/v3/projects/9f8d6323a6bd4739a1c866f2e164934f/users/29bd67fd9ac64f57acbf9d9492731655/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:27.134178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:27.189185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:27.198154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:27.449859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0070d-7706-4d01-a152-07a2669ee946 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:27.458748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:27.460442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.461360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.462016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.463439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 823/1643] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Jan 10 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:27.463648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:27.467441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:27.467881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:27.492564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2ab79-9ea3-4e9a-aee8-83712ed0ee81 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:27.505475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad14dc4-9f85-4a7c-9126-c88fd89ee653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:27.505475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14dc4-9f85-4a7c-9126-c88fd89ee653 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.505475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14dc4-9f85-4a7c-9126-c88fd89ee653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.505475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad14dc4-9f85-4a7c-9126-c88fd89ee653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.506297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14dc4-9f85-4a7c-9126-c88fd89ee653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:27.506297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad14dc4-9f85-4a7c-9126-c88fd89ee653 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:27.529756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 824/1644] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:27.529756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3868-57db-4db8-b05e-de6c2d968e06 None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.529756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3868-57db-4db8-b05e-de6c2d968e06 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.529756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3868-57db-4db8-b05e-de6c2d968e06 None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.533063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 825/1645] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jan 10 11:37:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:27.533817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3868-57db-4db8-b05e-de6c2d968e06 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:27.558985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3868-57db-4db8-b05e-de6c2d968e06 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:27.573728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:27.577184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.584880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.584880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.638967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 821/1646] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:27 2022] POST /identity/v3/users => generated 293 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:27.639822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:27.666485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9233-158a-4bf7-bd47-bd1962e43dc7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:27.683364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74516b93-78e9-4c71-8225-5f29f497542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:27.684833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516b93-78e9-4c71-8225-5f29f497542a admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.685363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516b93-78e9-4c71-8225-5f29f497542a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.685708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74516b93-78e9-4c71-8225-5f29f497542a admin admin] PATH_INFO: `/v3/projects/9f8d6323a6bd4739a1c866f2e164934f/users/29bd67fd9ac64f57acbf9d9492731655/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.689644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516b93-78e9-4c71-8225-5f29f497542a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8d6323a6bd4739a1c866f2e164934f, user_id=29bd67fd9ac64f57acbf9d9492731655, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:27.692963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74516b93-78e9-4c71-8225-5f29f497542a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:27.708270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 822/1647] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:27 2022] PUT /identity/v3/projects/9f8d6323a6bd4739a1c866f2e164934f/users/29bd67fd9ac64f57acbf9d9492731655/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:27.709858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce031a-2b9d-466e-865c-e3e6acdab0d5 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.710732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce031a-2b9d-466e-865c-e3e6acdab0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.710732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce031a-2b9d-466e-865c-e3e6acdab0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.751973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:27.753786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:27.764990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 826/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:27.765979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:27.775924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5fce031a-2b9d-466e-865c-e3e6acdab0d5 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:27.777092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c0f5f-8c04-4dd4-ba14-ad03c34104d8 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:27.781056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5fce031a-2b9d-466e-865c-e3e6acdab0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:27.883091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 823/1649] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:27.885045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.885045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.885386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.919467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] MFA Rules not processed for user `29bd67fd9ac64f57acbf9d9492731655`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:27.920699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:27.929234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:27.931911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:27.932469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:27.932973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:27.937533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:27.942967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:27.994877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 827/1650] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:27.996799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:28.007428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:28.095935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 824/1651] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:28.096918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:28.128166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6a714-1296-47e3-9f7f-f8a4f2fa50aa None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:28.149700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:28.153588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.154033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.155444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] PATH_INFO: `/v3/projects/c78c3ff2bfb6474baf5f49ecca10263f/users/69a2f07b2e044e7083ae392e3958e615/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.212811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78c3ff2bfb6474baf5f49ecca10263f, user_id=69a2f07b2e044e7083ae392e3958e615, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:28.213270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088fa22-498a-4709-af2b-42cd73a59638 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:28.222850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:28.224657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:28.226460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.228654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.229138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.247458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:28.250034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:28.266432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 828/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:28.268609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:28.326551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 825/1653] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:28 2022] PUT /identity/v3/projects/c78c3ff2bfb6474baf5f49ecca10263f/users/69a2f07b2e044e7083ae392e3958e615/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:28.332591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:28.560675 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a25895-f9b0-4d09-9a3f-e1f67ec595f9 service glance] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:28.580654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780060f5-5b6a-40a7-84ba-8197c1aa28d4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:28.580654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:28.580654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.580654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.581181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.581181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:28.583427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:28.603679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 826/1654] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:28.610073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:28.637042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec865a3-94f6-4d48-8ef0-c6b5749f6dcb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:28.651214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582871c-127b-401f-865b-08f573d82c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:28.668368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582871c-127b-401f-865b-08f573d82c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.668368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582871c-127b-401f-865b-08f573d82c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.668368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582871c-127b-401f-865b-08f573d82c0b admin admin] PATH_INFO: `/v3/projects/c78c3ff2bfb6474baf5f49ecca10263f/users/69a2f07b2e044e7083ae392e3958e615/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.668368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582871c-127b-401f-865b-08f573d82c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78c3ff2bfb6474baf5f49ecca10263f, user_id=69a2f07b2e044e7083ae392e3958e615, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:28.668368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582871c-127b-401f-865b-08f573d82c0b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:28.699256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 827/1655] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:28 2022] PUT /identity/v3/projects/c78c3ff2bfb6474baf5f49ecca10263f/users/69a2f07b2e044e7083ae392e3958e615/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:28.703473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c937a-4e58-4455-9292-8fda2545ee48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:28.704163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c937a-4e58-4455-9292-8fda2545ee48 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.704444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c937a-4e58-4455-9292-8fda2545ee48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.704725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c937a-4e58-4455-9292-8fda2545ee48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.771502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.772181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.772570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.826485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] MFA Rules not processed for user `69a2f07b2e044e7083ae392e3958e615`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:28.829162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:28.843456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c937a-4e58-4455-9292-8fda2545ee48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:28.845181 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c937a-4e58-4455-9292-8fda2545ee48 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:28.861217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 829/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:28.863995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20d526-14d3-4569-9b57-0fbceafe7b2b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.863995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20d526-14d3-4569-9b57-0fbceafe7b2b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.863995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20d526-14d3-4569-9b57-0fbceafe7b2b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.866952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 830/1657] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jan 10 11:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:28.873260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:28.874624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:28.875108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:28.900459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:28.901757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:28.939077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 828/1658] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:28.956870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:29.027315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 831/1659] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:37:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:29.093677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e546e83-59a3-4759-a5ed-bf367eb8d0b0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:29.098107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d21e6-7b64-4b7a-b177-bb7e75c670cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:29.098948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d21e6-7b64-4b7a-b177-bb7e75c670cc service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:29.099147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d21e6-7b64-4b7a-b177-bb7e75c670cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:29.099395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d21e6-7b64-4b7a-b177-bb7e75c670cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:29.111528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d21e6-7b64-4b7a-b177-bb7e75c670cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:29.113523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d21e6-7b64-4b7a-b177-bb7e75c670cc service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:29.128288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 829/1660] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:37:29.206987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:29.219308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c10a3d-40b6-44a5-9f1f-d8c15d6fde16 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:29.226581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18dd59-ea4d-4be8-a800-17e84999532e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:29.229757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dd59-ea4d-4be8-a800-17e84999532e service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:29.229757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dd59-ea4d-4be8-a800-17e84999532e service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:29.229757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dd59-ea4d-4be8-a800-17e84999532e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:29.243953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18dd59-ea4d-4be8-a800-17e84999532e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:29.245943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18dd59-ea4d-4be8-a800-17e84999532e service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:29.284007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 832/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:29.369382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d47ce-7063-40b8-9c67-e6f9132202a4 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:29.370511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d47ce-7063-40b8-9c67-e6f9132202a4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:29.371368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d47ce-7063-40b8-9c67-e6f9132202a4 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:29.376246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 830/1662] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jan 10 11:37:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:29.387336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:29.388096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:29.388445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:29.423649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d47ce-7063-40b8-9c67-e6f9132202a4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:29.448225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d47ce-7063-40b8-9c67-e6f9132202a4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:29.457938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6414bf-604c-48d9-8c42-9a7b7f6cc1a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:29.458993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6414bf-604c-48d9-8c42-9a7b7f6cc1a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:29.459315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6414bf-604c-48d9-8c42-9a7b7f6cc1a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:29.460185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6414bf-604c-48d9-8c42-9a7b7f6cc1a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:29.491869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:29.497763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:29.578874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6414bf-604c-48d9-8c42-9a7b7f6cc1a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:29.580686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6414bf-604c-48d9-8c42-9a7b7f6cc1a7 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:29.587049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 833/1663] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:37:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:29.599886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 831/1664] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:29.664919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:29.692942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:29.704184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fd62e-8707-4d2b-8bdf-3d60a8e9a956 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:29.722293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d175c4c-a218-4379-8b37-999fbece87a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:29.723503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175c4c-a218-4379-8b37-999fbece87a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:29.724018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175c4c-a218-4379-8b37-999fbece87a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:29.726035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d175c4c-a218-4379-8b37-999fbece87a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:29.741617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d175c4c-a218-4379-8b37-999fbece87a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:29.743290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d175c4c-a218-4379-8b37-999fbece87a1 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:29.766849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 834/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:30.701193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36e122-d3d7-4470-8ce0-1167bdb6f407 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:30.701736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36e122-d3d7-4470-8ce0-1167bdb6f407 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:30.701878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36e122-d3d7-4470-8ce0-1167bdb6f407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:30.793526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8e36e122-d3d7-4470-8ce0-1167bdb6f407 None None] MFA Rules not processed for user `8fa7971d6f99464bbe62c60e318cf414`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:30.795077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8e36e122-d3d7-4470-8ce0-1167bdb6f407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:30.995991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 832/1666] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:31.062555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.063580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.064151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.086848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822bc7b-4cc3-46c7-8163-fa9d7b127219 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.086848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822bc7b-4cc3-46c7-8163-fa9d7b127219 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.086848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822bc7b-4cc3-46c7-8163-fa9d7b127219 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.118875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 833/1667] 10.222.0.20 () {54 vars in 960 bytes} [Mon Jan 10 11:37:31 2022] GET /identity => generated 270 bytes in 36 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:31.135088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0cf8-74fb-4b10-be5d-8dec3d0d1f17 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.135088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0cf8-74fb-4b10-be5d-8dec3d0d1f17 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.135088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa0cf8-74fb-4b10-be5d-8dec3d0d1f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.169405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] MFA Rules not processed for user `8fa7971d6f99464bbe62c60e318cf414`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:31.169405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:31.207325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 835/1668] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:31.207577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a4aa0cf8-74fb-4b10-be5d-8dec3d0d1f17 None None] MFA Rules not processed for user `b67735ed66544af696d9274554f3001d`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:31.217081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a4aa0cf8-74fb-4b10-be5d-8dec3d0d1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:31.217772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:31.255066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27285de-b08b-462f-90ca-f6b70c5e7c33 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:31.269806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:31.270821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.271611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.271611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.291533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:31.294739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:31.315802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 836/1669] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:31.405577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 834/1670] 10.222.0.20 () {58 vars in 1057 bytes} [Mon Jan 10 11:37:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:31.409823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:31.427665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e04c03-c35a-4273-b401-6c6ba56c7ed6 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:31.440432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:31.441194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.441480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.441759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.447389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:31.477372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:31.479045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd39be6-3aa7-4419-8469-8c4ff184029f service placement] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:31.508234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 837/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:31.809388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a05c9-f66e-4e49-ab1e-f54e284c08fb None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.810040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a05c9-f66e-4e49-ab1e-f54e284c08fb None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.810143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a05c9-f66e-4e49-ab1e-f54e284c08fb None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.812457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 835/1672] 10.222.0.20 () {54 vars in 912 bytes} [Mon Jan 10 11:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:31.832821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:31.833531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:31.834063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:31.872491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a05c9-f66e-4e49-ab1e-f54e284c08fb None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:31.899350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:31.905741 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:31.927854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 838/1673] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:37:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:31.997985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:32.011756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf723c9-ce2b-44b1-8552-be9a0fd029eb None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:32.020620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8b4a0-3630-4a90-bc9a-3c42c98cd6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:32.021491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8b4a0-3630-4a90-bc9a-3c42c98cd6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:32.022981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8b4a0-3630-4a90-bc9a-3c42c98cd6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:32.023411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8b4a0-3630-4a90-bc9a-3c42c98cd6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:32.052547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8b4a0-3630-4a90-bc9a-3c42c98cd6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:32.056842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8b4a0-3630-4a90-bc9a-3c42c98cd6e4 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:32.074964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a05c9-f66e-4e49-ab1e-f54e284c08fb None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:32.076309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 839/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:32.083194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:32.085471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:32.085861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:32.087032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] PATH_INFO: `/v3/users/160bbca382424370839263f594fe964d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:32.090569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160bbca382424370839263f594fe964d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:32.093279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: WARNING py.warnings [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:37:32.093279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: warnings.warn(msg) Jan 10 11:37:32.093279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: Jan 10 11:37:32.096359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:32.585892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160bbca382424370839263f594fe964d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:32.671771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160bbca382424370839263f594fe964d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:32.671771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160bbca382424370839263f594fe964d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:32.702444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160bbca382424370839263f594fe964d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:32.854852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160bbca382424370839263f594fe964d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:32.901712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 836/1675] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:31 2022] DELETE /identity/v3/users/160bbca382424370839263f594fe964d => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:32.906672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:32.918130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:32.918130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:32.947313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:32.948753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:33.070604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 840/1676] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:33.117303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:33.121270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:33.255706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a1492-c3d7-4286-82db-fb4aba3f3335 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:33.262177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:33.263602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:33.264005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:33.264339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:33.278484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:33.280648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:33.296673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 837/1677] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:35.332217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:35.333495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:35.358350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621981d-c9ae-4136-a7e2-f40bf2c908d2 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:35.364070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:35.365444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:35.365926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:35.366417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] PATH_INFO: `/v3/projects/0384f08acae8463ca10014602323f6d5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:35.372469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0384f08acae8463ca10014602323f6d5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:35.372469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: WARNING py.warnings [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:37:35.372469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: warnings.warn(msg) Jan 10 11:37:35.372469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: Jan 10 11:37:35.374639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:35.405656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:35.407123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:35.438726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6966190-9bc9-4720-8ea3-d27003737f44 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:35.464486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:35.464486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:35.464486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:35.464486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] PATH_INFO: `/v3/users/315f06b898ff41ddaa5868bc9a718582` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:35.465513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=315f06b898ff41ddaa5868bc9a718582)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:35.467668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:35.695352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0384f08acae8463ca10014602323f6d5', 'request_id': 'req-c7f2c05a-7a7d-4781-bffd-da7eddac3063'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.844353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315f06b898ff41ddaa5868bc9a718582'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.870463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315f06b898ff41ddaa5868bc9a718582'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.871478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315f06b898ff41ddaa5868bc9a718582'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.888928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315f06b898ff41ddaa5868bc9a718582'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.905810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0384f08acae8463ca10014602323f6d5', 'request_id': 'req-c7f2c05a-7a7d-4781-bffd-da7eddac3063'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.935621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0384f08acae8463ca10014602323f6d5', 'request_id': 'req-c7f2c05a-7a7d-4781-bffd-da7eddac3063'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.971003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] The token cache is being invalidate because project 0384f08acae8463ca10014602323f6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:35.975738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.978676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:35.982709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 841/1678] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:35 2022] DELETE /identity/v3/projects/0384f08acae8463ca10014602323f6d5 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:35.994534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:35.996715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:36.027546 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-98a36ee0-60d6-405b-b522-2620e7ef6550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315f06b898ff41ddaa5868bc9a718582'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:36.035443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 838/1679] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:35 2022] DELETE /identity/v3/users/315f06b898ff41ddaa5868bc9a718582 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:36.040597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:36.040985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:36.041334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:36.110878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2c05a-7a7d-4781-bffd-da7eddac3063 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:36.112240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:36.113860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:36.192941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:36.194699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:36.199117 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:36.199825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] PATH_INFO: `/v3/users/69a2f07b2e044e7083ae392e3958e615` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:36.202569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a2f07b2e044e7083ae392e3958e615)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:36.204795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:36.305411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 839/1680] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:37:36.318083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:36.321436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:36.526595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec317c-bca8-42b4-b2b0-d76eb69556c8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:36.534393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:36.535412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:36.536217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:36.536644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:36.554488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:36.556955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:36.575318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 840/1681] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:37:36.627667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a2f07b2e044e7083ae392e3958e615'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:36.638789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a2f07b2e044e7083ae392e3958e615'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:36.639839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a2f07b2e044e7083ae392e3958e615'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:36.640719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a2f07b2e044e7083ae392e3958e615'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:36.699285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-478c922d-3405-44a7-8d00-4ba46dae104a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a2f07b2e044e7083ae392e3958e615'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:36.885663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 842/1682] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:35 2022] DELETE /identity/v3/users/69a2f07b2e044e7083ae392e3958e615 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:38.100484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:38.102921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:38.160529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95ad11-f14e-49b5-992b-9e98ed61a400 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:38.353735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:38.354691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:38.355016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:38.355611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] PATH_INFO: `/v3/projects/9266798caa6b4b9b9bb1e690659b268f` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:38.358159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9266798caa6b4b9b9bb1e690659b268f)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:38.360923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:38.557445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:38.557950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:38.558040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:38.597690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] MFA Rules not processed for user `2c652557dbd54165a3498c08b2dd5673`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:38.599100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:38.681097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 843/1683] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:38.693158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:38.695191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:38.776088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faf510-37ea-4263-925e-b9ee715275ea None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:38.782017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:38.782717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:38.782999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:38.783271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:38.792832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:38.794452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:38.807059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 844/1684] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:39.082257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9266798caa6b4b9b9bb1e690659b268f', 'request_id': 'req-b159185c-6373-4869-a1be-4672414d0a38'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.082440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:39.082440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:39.102002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f53b7-4118-40b2-abb3-4af3baca1614 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:39.237030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9266798caa6b4b9b9bb1e690659b268f', 'request_id': 'req-b159185c-6373-4869-a1be-4672414d0a38'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.245385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9266798caa6b4b9b9bb1e690659b268f', 'request_id': 'req-b159185c-6373-4869-a1be-4672414d0a38'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.279513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] The token cache is being invalidate because project 9266798caa6b4b9b9bb1e690659b268f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:39.280444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.281442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b159185c-6373-4869-a1be-4672414d0a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.289617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 841/1685] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:38 2022] DELETE /identity/v3/projects/9266798caa6b4b9b9bb1e690659b268f => generated 0 bytes in 1185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:39.291375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf17d-fd7c-4d84-8aac-444d1d711f0d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.291834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf17d-fd7c-4d84-8aac-444d1d711f0d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.292395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf17d-fd7c-4d84-8aac-444d1d711f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.295822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:39.297329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.297623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.297943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] PATH_INFO: `/v3/projects/c78c3ff2bfb6474baf5f49ecca10263f` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.299412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78c3ff2bfb6474baf5f49ecca10263f)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:39.301913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:39.345956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f1eaf17d-fd7c-4d84-8aac-444d1d711f0d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:39.347845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f1eaf17d-fd7c-4d84-8aac-444d1d711f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:39.371101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 842/1686] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:39.380680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.391310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.392380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.474707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:39.477408 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:39.497001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 843/1687] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:39.500973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:39.522703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbba8e-a174-4396-9a96-e72c16dada55 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:39.526800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78c3ff2bfb6474baf5f49ecca10263f', 'request_id': 'req-d5c27088-602a-434b-81f5-b767bf671793'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.656727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:39.657632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.658422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.659485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.659690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78c3ff2bfb6474baf5f49ecca10263f', 'request_id': 'req-d5c27088-602a-434b-81f5-b767bf671793'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.661725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:39.662158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:39.666907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78c3ff2bfb6474baf5f49ecca10263f', 'request_id': 'req-d5c27088-602a-434b-81f5-b767bf671793'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.671866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:39.692595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] The token cache is being invalidate because project c78c3ff2bfb6474baf5f49ecca10263f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:39.693589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.696450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-d5c27088-602a-434b-81f5-b767bf671793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:39.700537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 845/1688] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:39 2022] DELETE /identity/v3/projects/c78c3ff2bfb6474baf5f49ecca10263f => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:37:39.706183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd567f4-c721-4171-9eea-e552bcfc2687 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.706976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd567f4-c721-4171-9eea-e552bcfc2687 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.707398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd567f4-c721-4171-9eea-e552bcfc2687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.713350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 844/1689] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:39.721431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:39.723416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:39.753352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3bd567f4-c721-4171-9eea-e552bcfc2687 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:39.754095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b06a72-ad33-49d4-bfd5-02b09862ecc8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:39.755253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3bd567f4-c721-4171-9eea-e552bcfc2687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:39.766295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 846/1690] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:39.773524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:39.774801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.775095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.775376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.775615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.776011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.776381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.777196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:39.780691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:39.794142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:39.795430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:39.806021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 847/1691] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:39.816870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:39.832044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab3d26-1136-44fc-8694-c5f510806d9f None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:39.837991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:39.839193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.839674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.840177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.841315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:39.841986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:39.844435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:39.863868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 848/1692] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:39.865452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:39.877129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86d290-8b1c-4be4-988c-be04320c5397 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:39.892229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:39.892229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:39.892463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:39.892770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:39.893680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:39.898371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:39.951775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 845/1693] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:39.956293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.076949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 849/1694] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:40.082316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.177606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22abd0b-c293-414a-8432-2c65a65c8332 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.257302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69910ee-be2c-41bd-ac45-d18678979ada admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.269382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.274743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.274743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.274743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.275623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.277797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.375030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.375737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.376411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.376697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.377427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.382115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.494918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 850/1695] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:40 2022] POST /identity/v3/users => generated 281 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:40.495880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.508103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9294976-31d4-45ea-b542-ccb47e17706c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.526392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.527158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.527444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.527728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.528458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.530324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.544432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 851/1696] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:40.549491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.561965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f78d-6c06-478f-9601-d0b3995e5b53 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.567034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.567718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.570387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.570730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.571520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.573163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.589962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 852/1697] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:40.591945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.605858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d83b2-1be3-4cc2-817e-59338fc9d69a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.614176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e2dbd-5e70-4f14-ae44-0d0e14a2b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.616477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e2dbd-5e70-4f14-ae44-0d0e14a2b7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.617044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e2dbd-5e70-4f14-ae44-0d0e14a2b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.617533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e2dbd-5e70-4f14-ae44-0d0e14a2b7a7 admin admin] PATH_INFO: `/v3/projects/0a1a80fbcafe4cc6b1a6f5c787a24a60/users/0899616b5e204eb4a5b559fb0e5d65da/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.634391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 846/1698] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:39 2022] POST /identity/v3/users => generated 291 bytes in 678 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:37:40.645275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e2dbd-5e70-4f14-ae44-0d0e14a2b7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1a80fbcafe4cc6b1a6f5c787a24a60, user_id=0899616b5e204eb4a5b559fb0e5d65da, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.647604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.649461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e2dbd-5e70-4f14-ae44-0d0e14a2b7a7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.662491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f44f7-6c3d-4dd7-9cad-ee881fee941f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.678933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.680026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.681435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.685989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.685989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.696556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.721560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 847/1699] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:37:40.725965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.746543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26158e-b927-4dc0-bf2d-98557d1c64f5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:40.758533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:40.759221 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.759511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.759728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 853/1700] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:40 2022] PUT /identity/v3/projects/0a1a80fbcafe4cc6b1a6f5c787a24a60/users/0899616b5e204eb4a5b559fb0e5d65da/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:40.761922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.766127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:40.766127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:40.776316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:40.776609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:40.776890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:40.803927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 848/1701] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:40.809642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:40.841540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] MFA Rules not processed for user `0899616b5e204eb4a5b559fb0e5d65da`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:40.856618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:40.868870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb16085-488d-42ed-a64c-2a4641d0844b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:41.060287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d471fb4-c683-4348-a3b5-908f273cb510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:41.061173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d471fb4-c683-4348-a3b5-908f273cb510 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:41.061631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d471fb4-c683-4348-a3b5-908f273cb510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:41.061745 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d471fb4-c683-4348-a3b5-908f273cb510 admin admin] PATH_INFO: `/v3/projects/3cb5ec10331845a8892c1e83b83814f9/users/db359e80495e498bb7a334311febaa08/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:41.132459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 854/1702] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:37:41.136627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:41.137798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d471fb4-c683-4348-a3b5-908f273cb510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb5ec10331845a8892c1e83b83814f9, user_id=db359e80495e498bb7a334311febaa08, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:41.140598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d471fb4-c683-4348-a3b5-908f273cb510 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:41.189395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c177973-a0c5-437b-8d0d-be6e726f8680 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:41.213009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:41.214019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:41.214546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:41.215037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:41.215951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:41.220482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:41.302867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 849/1703] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:40 2022] PUT /identity/v3/projects/3cb5ec10331845a8892c1e83b83814f9/users/db359e80495e498bb7a334311febaa08/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:37:41.304999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b249-80ec-4f5c-8d80-79c50f49af78 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:41.306643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b249-80ec-4f5c-8d80-79c50f49af78 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:41.306939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b249-80ec-4f5c-8d80-79c50f49af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:41.405264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 855/1704] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:41 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:41.406314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:41.446826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8ca9b249-80ec-4f5c-8d80-79c50f49af78 None None] MFA Rules not processed for user `db359e80495e498bb7a334311febaa08`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:41.452588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8ca9b249-80ec-4f5c-8d80-79c50f49af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:41.608366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d840fc-82c7-4233-8b9e-627ef64c8eb2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:41.622980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:41.623922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:41.624354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:41.624802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:41.625697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:41.639559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:41.768200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 850/1705] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:41.769347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 856/1706] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:41 2022] POST /identity/v3/users => generated 289 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:41.776759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:41.777189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:41.778047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:41.783295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:41.794830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e605cf-e2b0-4115-a731-a976d34ea48e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:41.811507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:41.812460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:41.812887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:41.813313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:41.814182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:41.816339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:41.828740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:41.833478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:42.018940 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 857/1707] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:41 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:42.020314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:42.023829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 851/1708] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:42.025056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:42.064771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edcd97-642f-48da-8937-71f2a02135e0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:42.270010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b2d27-1699-4e7d-a024-262f9f71bac9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:42.282566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:42.283408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.288287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.288287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.288287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:42.288287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:42.292269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:42.292979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.293277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.293539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.298365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:42.306557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:42.322767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 858/1709] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:42.335800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:42.370427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4050b4f-20bc-48bb-a26e-7bd7378ba38a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:42.396933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:42.403006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.403006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.403006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] PATH_INFO: `/v3/projects/465ad1dcfd264bc8bb4e3700667c33a2/users/9660df9d81bb4da393201900a672a746/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.461824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=465ad1dcfd264bc8bb4e3700667c33a2, user_id=9660df9d81bb4da393201900a672a746, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:42.464630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:42.519536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 852/1710] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:37:42 2022] POST /identity/v3/users => generated 296 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:42.526886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:42.557310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faef63-c6cd-40b2-abbf-44d075a32f9d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:42.582861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097de39-cf18-4404-bd11-f3ac73a9e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:42.585784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097de39-cf18-4404-bd11-f3ac73a9e4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.587093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097de39-cf18-4404-bd11-f3ac73a9e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.587537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097de39-cf18-4404-bd11-f3ac73a9e4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.589054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 859/1711] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:42 2022] PUT /identity/v3/projects/465ad1dcfd264bc8bb4e3700667c33a2/users/9660df9d81bb4da393201900a672a746/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:37:42.592708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097de39-cf18-4404-bd11-f3ac73a9e4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:42.593053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:42.601349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097de39-cf18-4404-bd11-f3ac73a9e4f2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:42.646946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 853/1712] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:42.649581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.656070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.660169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.709186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b754817-b4ee-45f2-80c5-828972f38f09 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:42.724787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:42.724787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.724787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.724787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.725724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:42.726865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:42.738484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] MFA Rules not processed for user `14216d42be0e4e1690f9a77a09e25967`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:42.747691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:42.774734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 860/1713] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:42.779922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:42.790538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:42.916576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40b6a2-8911-45fc-8753-98e975b8e83c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:42.926271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:42.927034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:42.927541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:42.928013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:42.986309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 854/1714] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:42.986309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:43.016776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf202e-8fdf-4c45-a9b1-28c62e65fa30 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:43.043076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74ea9c-0d26-4145-9157-4d8c93421508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:43.044097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ea9c-0d26-4145-9157-4d8c93421508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:43.044371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ea9c-0d26-4145-9157-4d8c93421508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:43.044660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74ea9c-0d26-4145-9157-4d8c93421508 admin admin] PATH_INFO: `/v3/projects/47252c05a3fe47088b67398c3212bd5c/users/8b2d3b17ad434897b5aaa0c8f0d25eca/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:43.079049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74ea9c-0d26-4145-9157-4d8c93421508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47252c05a3fe47088b67398c3212bd5c, user_id=8b2d3b17ad434897b5aaa0c8f0d25eca, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:43.081872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74ea9c-0d26-4145-9157-4d8c93421508 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:43.088809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:43.090498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:43.105691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 861/1715] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:37:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:37:43.108229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:43.140968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc69c2-445a-4dd8-8933-6a28e3e50336 service swift] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:43.162039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110d1c0-e3b1-43c3-a1b2-dbee6fea6f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:43.175132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d1c0-e3b1-43c3-a1b2-dbee6fea6f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:43.175489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d1c0-e3b1-43c3-a1b2-dbee6fea6f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:43.175778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110d1c0-e3b1-43c3-a1b2-dbee6fea6f0e admin admin] PATH_INFO: `/v3/projects/465ad1dcfd264bc8bb4e3700667c33a2/users/9660df9d81bb4da393201900a672a746/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:43.185914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110d1c0-e3b1-43c3-a1b2-dbee6fea6f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=465ad1dcfd264bc8bb4e3700667c33a2, user_id=9660df9d81bb4da393201900a672a746, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:43.189143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110d1c0-e3b1-43c3-a1b2-dbee6fea6f0e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:43.230030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 862/1716] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:43 2022] PUT /identity/v3/projects/465ad1dcfd264bc8bb4e3700667c33a2/users/9660df9d81bb4da393201900a672a746/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:43.241984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108395-36c6-4e09-900c-2b6134884639 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:43.242371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108395-36c6-4e09-900c-2b6134884639 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:43.242671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108395-36c6-4e09-900c-2b6134884639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:43.249177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 855/1717] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:42 2022] PUT /identity/v3/projects/47252c05a3fe47088b67398c3212bd5c/users/8b2d3b17ad434897b5aaa0c8f0d25eca/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:43.250606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:43.251001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:43.251230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:43.305127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-49108395-36c6-4e09-900c-2b6134884639 None None] MFA Rules not processed for user `14216d42be0e4e1690f9a77a09e25967`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:43.311786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-49108395-36c6-4e09-900c-2b6134884639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:43.403533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] MFA Rules not processed for user `9660df9d81bb4da393201900a672a746`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:43.409299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:43.532484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 856/1718] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:43.533227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 863/1719] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:43.555126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:43.555401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:43.558842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:43.563170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:43.639148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] MFA Rules not processed for user `0a3ea138daa84701bbf756e1ec43fb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:43.640916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:43.871342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 864/1720] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:43.871342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:43.873273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:43.923026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374c08-1dbd-4991-ad67-29759a1d4587 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:43.959034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:43.962257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:43.963958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:43.964850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:43.967139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:43.972231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:44.035886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 857/1721] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:37:44.040763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:44.045403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:44.175071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb94721-8467-4338-b953-73dd4cdc88ae None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:44.201457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:44.202140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:44.202444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:44.202735 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:44.255293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:44.261066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:44.289009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 865/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:44.289857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:44.314869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f276c-c7da-4b8f-b45a-5cf7c1fdbe58 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:44.360133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:44.367220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:44.375065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:44.375353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] PATH_INFO: `/v3/projects/47252c05a3fe47088b67398c3212bd5c/users/8b2d3b17ad434897b5aaa0c8f0d25eca/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:44.390783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47252c05a3fe47088b67398c3212bd5c, user_id=8b2d3b17ad434897b5aaa0c8f0d25eca, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:44.394444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:44.409110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65dd20-f622-4f92-94bf-8b67b226df16 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:44.422273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 866/1723] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:37:44 2022] PUT /identity/v3/projects/47252c05a3fe47088b67398c3212bd5c/users/8b2d3b17ad434897b5aaa0c8f0d25eca/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:44.426033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:44.431801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:44.733494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a3cb-5de4-4460-9838-53366b3f8307 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:44.735792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9828f-f982-4f9e-986a-7eee47c5922f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:44.737872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9828f-f982-4f9e-986a-7eee47c5922f service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:44.738688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9828f-f982-4f9e-986a-7eee47c5922f service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:44.740259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9828f-f982-4f9e-986a-7eee47c5922f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:44.748897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:44.749613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:44.749959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:44.750288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:44.958985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9828f-f982-4f9e-986a-7eee47c5922f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:44.965150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9828f-f982-4f9e-986a-7eee47c5922f service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:44.965914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:44.972128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:45.021606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 858/1724] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 985 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:45.031674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd935f5-302c-45dc-8a9e-fa8fd61815d9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:45.031774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd935f5-302c-45dc-8a9e-fa8fd61815d9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:45.032053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd935f5-302c-45dc-8a9e-fa8fd61815d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:45.058295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 867/1725] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:45.059292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:45.153381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6dd935f5-302c-45dc-8a9e-fa8fd61815d9 None None] MFA Rules not processed for user `8b2d3b17ad434897b5aaa0c8f0d25eca`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:45.156769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6dd935f5-302c-45dc-8a9e-fa8fd61815d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:45.247330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c7f3-17d8-41b6-98b1-f9182ef3ca74 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:45.281312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:45.289053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:45.289561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:45.289721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:45.386581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 859/1726] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:45.390660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:45.391101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:45.391717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:45.448129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:45.448827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:45.449847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:45.452767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:45.478273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 868/1727] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:45.491629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:45.496255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:45.560652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b33c-e2ea-46a9-aa21-4fea772edaf1 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:45.581051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:45.581757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:45.587232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:45.587619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:45.637074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:45.644169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:45.662386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 860/1728] 10.222.0.31 () {58 vars in 1015 bytes} [Mon Jan 10 11:37:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:45.678147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:45.682901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:45.686977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 869/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:45.702543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9229434-ac20-40f3-9f68-481475e5643e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:45.718703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:45.719590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:45.720056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:45.720338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:45.753065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:45.757799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:45.783663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 861/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:47.945643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:47.951524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d24fb-39ae-46c5-a539-bde70e38893c service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:47.977988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d3b17ad434897b5aaa0c8f0d25eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47252c05a3fe47088b67398c3212bd5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:47.978817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:47.980885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:47.995621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:48.003212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:48.003212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:48.010620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:48.051075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 870/1731] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:48.056754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:48.102929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307f3ff-5663-4148-ab33-e04c54196abe service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:48.115521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d3b17ad434897b5aaa0c8f0d25eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47252c05a3fe47088b67398c3212bd5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:48.117984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:48.118406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:48.118715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:48.122451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:48.128452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:48.669555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:48.676970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 862/1732] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:48 2022] POST /identity/v3/projects => generated 355 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:37:48.691895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a7277-c4b8-4160-a656-0646c87248f3 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:48.843077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d3b17ad434897b5aaa0c8f0d25eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47252c05a3fe47088b67398c3212bd5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:48.845281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:48.845702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:48.846585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:48.852746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:48.852746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:48.852746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b1e97-2d9e-4664-a41f-430a44456faf tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:48.898938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 871/1733] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:48.978706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:48.997934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e996a7-d408-4224-ab49-3a685b3d5162 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:49.024899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d3b17ad434897b5aaa0c8f0d25eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47252c05a3fe47088b67398c3212bd5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:49.025800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:49.026075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:49.026411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] PATH_INFO: `/v3/projects/ef78b5d931f04adf93fa912af4e7d817` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:49.075465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef78b5d931f04adf93fa912af4e7d817)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:49.075465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:49.125545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d532-b8ec-4f68-bd03-402a5d885b7b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:49.126110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d532-b8ec-4f68-bd03-402a5d885b7b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:49.126447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d532-b8ec-4f68-bd03-402a5d885b7b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:49.130150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 872/1734] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:49.307488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:49.307703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:49.307981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:49.347511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:49.352075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:49.604748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 873/1735] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:37:49.671776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:49.683179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d75856-a778-4660-92eb-c293cf6e8a37 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:49.700480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efcc83-5f8f-4cc0-91c8-4773be37326d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:49.701415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efcc83-5f8f-4cc0-91c8-4773be37326d service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:49.701862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efcc83-5f8f-4cc0-91c8-4773be37326d service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:49.702346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efcc83-5f8f-4cc0-91c8-4773be37326d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:49.729445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efcc83-5f8f-4cc0-91c8-4773be37326d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:49.732025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efcc83-5f8f-4cc0-91c8-4773be37326d service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:49.746114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 874/1736] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:37:49.748105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:49.748654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:49.749218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:49.789664 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] MFA Rules not processed for user `14216d42be0e4e1690f9a77a09e25967`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:49.808435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:49.827720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef78b5d931f04adf93fa912af4e7d817', 'request_id': 'req-dd5551f1-5c72-417e-96eb-f55f3e7738e5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:50.022414 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 875/1737] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:50.075160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef78b5d931f04adf93fa912af4e7d817', 'request_id': 'req-dd5551f1-5c72-417e-96eb-f55f3e7738e5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:50.094020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef78b5d931f04adf93fa912af4e7d817', 'request_id': 'req-dd5551f1-5c72-417e-96eb-f55f3e7738e5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:50.120723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] The token cache is being invalidate because project ef78b5d931f04adf93fa912af4e7d817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:50.123017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:50.124788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd5551f1-5c72-417e-96eb-f55f3e7738e5 tempest-VolumeQuotaClassesTest-430314879 tempest-VolumeQuotaClassesTest-430314879-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:50.130457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 863/1738] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:48 2022] DELETE /identity/v3/projects/ef78b5d931f04adf93fa912af4e7d817 => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:51.632608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:51.915105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56822b3b-7044-49a2-8f1e-bd0fff6eaeb7 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:51.939683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:51.947601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:51.947601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:51.947601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] PATH_INFO: `/v3/users/db359e80495e498bb7a334311febaa08` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:51.947601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db359e80495e498bb7a334311febaa08)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:51.947601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:52.335731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db359e80495e498bb7a334311febaa08'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:52.349893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db359e80495e498bb7a334311febaa08'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:52.355971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db359e80495e498bb7a334311febaa08'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:52.355971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db359e80495e498bb7a334311febaa08'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:52.385097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db359e80495e498bb7a334311febaa08'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:52.554269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 876/1739] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:51 2022] DELETE /identity/v3/users/db359e80495e498bb7a334311febaa08 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:52.562766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:52.567423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:52.567423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:52.587878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:52.589518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:52.797179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 864/1740] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:52.799961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:52.801499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:52.933202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:52.941708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:53.023236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdb6a-fea6-4a88-a120-b9a746f88a5e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:53.031806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bbef2-d614-4da4-b56c-254bde7916bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:53.033145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bbef2-d614-4da4-b56c-254bde7916bb service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:53.033645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bbef2-d614-4da4-b56c-254bde7916bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:53.034148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bbef2-d614-4da4-b56c-254bde7916bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:53.051996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bbef2-d614-4da4-b56c-254bde7916bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:53.054752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bbef2-d614-4da4-b56c-254bde7916bb service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:53.075424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 877/1741] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:53.082146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceaabc-5738-4b96-ac8e-21a8d9ea875b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:53.132982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:53.135489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:53.136372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:53.137141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] PATH_INFO: `/v3/users/0899616b5e204eb4a5b559fb0e5d65da` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:53.140043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0899616b5e204eb4a5b559fb0e5d65da)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:53.155551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:53.558253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93181c75-3577-4f5c-9fe3-ecf93b83531c None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:53.558734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93181c75-3577-4f5c-9fe3-ecf93b83531c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:53.561986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93181c75-3577-4f5c-9fe3-ecf93b83531c None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:53.569601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 878/1742] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:37:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:37:53.597491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0899616b5e204eb4a5b559fb0e5d65da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:53.650166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:53.653960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:53.655104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:53.668319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0899616b5e204eb4a5b559fb0e5d65da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:53.669784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0899616b5e204eb4a5b559fb0e5d65da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:53.705263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:53.705263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:53.705703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0899616b5e204eb4a5b559fb0e5d65da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:53.928720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cea77ec8-22b1-496b-ae5f-16f5fd3eb7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0899616b5e204eb4a5b559fb0e5d65da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:53.950149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 865/1743] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:52 2022] DELETE /identity/v3/users/0899616b5e204eb4a5b559fb0e5d65da => generated 0 bytes in 1015 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:53.952958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 879/1744] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:53.957650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befd2ff-6158-4c79-8d50-11c869a2742c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:53.974311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befd2ff-6158-4c79-8d50-11c869a2742c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:53.979487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befd2ff-6158-4c79-8d50-11c869a2742c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:54.047781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7befd2ff-6158-4c79-8d50-11c869a2742c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:54.052969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7befd2ff-6158-4c79-8d50-11c869a2742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:54.217081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 866/1745] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:54.408867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:54.432309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee9e83-4663-4508-860b-3caa9b234037 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:54.451029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:54.455426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:54.455426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:54.516338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] MFA Rules not processed for user `2c652557dbd54165a3498c08b2dd5673`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:54.520163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:54.639345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:54.641185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:54.642927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:54.643981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:54.657497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 867/1746] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:54.672593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:54.676255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:54.707687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 880/1747] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:54.842153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:54.842545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:55.180920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855d0d2-73e0-4675-b4cb-b4cddee9eb7b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:55.199378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:55.200415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:55.200614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:55.201120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:55.207386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:55.229503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:55.233491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:55.261654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 868/1748] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:37:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:37:55.329257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:55.330942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:55.363713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3125ec-9644-4060-b7c5-e9c2512e59a7 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:55.377830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:55.379022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:55.379695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:55.380287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] PATH_INFO: `/v3/projects/3cb5ec10331845a8892c1e83b83814f9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:55.392707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb5ec10331845a8892c1e83b83814f9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:55.395131 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:55.702943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb5ec10331845a8892c1e83b83814f9', 'request_id': 'req-c29ac80a-02ec-4b22-84e6-de1d886a2106'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:56.661455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb5ec10331845a8892c1e83b83814f9', 'request_id': 'req-c29ac80a-02ec-4b22-84e6-de1d886a2106'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:56.672228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb5ec10331845a8892c1e83b83814f9', 'request_id': 'req-c29ac80a-02ec-4b22-84e6-de1d886a2106'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:56.703502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] The token cache is being invalidate because project 3cb5ec10331845a8892c1e83b83814f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:56.704544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:56.706536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c29ac80a-02ec-4b22-84e6-de1d886a2106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:56.709095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 881/1749] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:55 2022] DELETE /identity/v3/projects/3cb5ec10331845a8892c1e83b83814f9 => generated 0 bytes in 1380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:56.714074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:56.732531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6267-7150-41b7-9e55-325e20959a70 service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:56.899028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:56.901955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:56.902858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:56.903142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] PATH_INFO: `/v3/users/8b2d3b17ad434897b5aaa0c8f0d25eca` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:56.906438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2d3b17ad434897b5aaa0c8f0d25eca)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:56.916333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:57.266403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:57.267084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:57.267727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:57.309516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] MFA Rules not processed for user `0a3ea138daa84701bbf756e1ec43fb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:57.310535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2d3b17ad434897b5aaa0c8f0d25eca'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:57.311573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:57.363527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2d3b17ad434897b5aaa0c8f0d25eca'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:57.365155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2d3b17ad434897b5aaa0c8f0d25eca'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:57.385108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2d3b17ad434897b5aaa0c8f0d25eca'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:57.516330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 882/1750] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:37:57.541268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2d3b17ad434897b5aaa0c8f0d25eca'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:57.554632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 869/1751] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:56 2022] DELETE /identity/v3/users/8b2d3b17ad434897b5aaa0c8f0d25eca => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:58.026412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:58.028358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:58.078522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fccb57-232b-47f3-8ecc-961ce8958703 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:58.263010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:58.274480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:58.275068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:58.275772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] PATH_INFO: `/v3/projects/0a1a80fbcafe4cc6b1a6f5c787a24a60` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:58.277400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1a80fbcafe4cc6b1a6f5c787a24a60)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:58.280324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:58.512475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1a80fbcafe4cc6b1a6f5c787a24a60', 'request_id': 'req-19143a18-9acf-48cf-b1f8-592be489d8e4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:58.620959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1a80fbcafe4cc6b1a6f5c787a24a60', 'request_id': 'req-19143a18-9acf-48cf-b1f8-592be489d8e4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:58.630495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1a80fbcafe4cc6b1a6f5c787a24a60', 'request_id': 'req-19143a18-9acf-48cf-b1f8-592be489d8e4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:58.647345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] The token cache is being invalidate because project 0a1a80fbcafe4cc6b1a6f5c787a24a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:58.648021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:58.649657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:58.652860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 883/1752] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:58 2022] DELETE /identity/v3/projects/0a1a80fbcafe4cc6b1a6f5c787a24a60 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:58.658889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:58.661421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:58.705247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599c61-b50a-4321-bc28-e1fd6553e7f5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:58.898870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:58.900763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:58.900763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:58.900763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] PATH_INFO: `/v3/users/9660df9d81bb4da393201900a672a746` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:58.901794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9660df9d81bb4da393201900a672a746)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:58.903975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:58.972806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:58.972806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:58.982874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143a18-9acf-48cf-b1f8-592be489d8e4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:59.000229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:59.001137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:59.001456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:59.001754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] PATH_INFO: `/v3/projects/47252c05a3fe47088b67398c3212bd5c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:59.003319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47252c05a3fe47088b67398c3212bd5c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:59.006587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:59.322433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9660df9d81bb4da393201900a672a746'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.325013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47252c05a3fe47088b67398c3212bd5c', 'request_id': 'req-5915a82a-77fa-43f4-ab9e-5315192a01f2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.335362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9660df9d81bb4da393201900a672a746'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.335948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9660df9d81bb4da393201900a672a746'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.343104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9660df9d81bb4da393201900a672a746'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.443299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47252c05a3fe47088b67398c3212bd5c', 'request_id': 'req-5915a82a-77fa-43f4-ab9e-5315192a01f2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.474059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47252c05a3fe47088b67398c3212bd5c', 'request_id': 'req-5915a82a-77fa-43f4-ab9e-5315192a01f2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.498630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] The token cache is being invalidate because project 47252c05a3fe47088b67398c3212bd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:37:59.502764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.502764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5915a82a-77fa-43f4-ab9e-5315192a01f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.511851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 884/1753] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:37:58 2022] DELETE /identity/v3/projects/47252c05a3fe47088b67398c3212bd5c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:59.513869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:59.514452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:59.515837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:59.565813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:59.566770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:59.591233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-967c4944-f9ab-4eba-91aa-e1495e55224c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9660df9d81bb4da393201900a672a746'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:37:59.603623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 870/1754] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:37:58 2022] DELETE /identity/v3/users/9660df9d81bb4da393201900a672a746 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:37:59.690637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 885/1755] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:59.697609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:59.698475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:59.698475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:59.722325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:37:59.723870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:37:59.879809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 871/1756] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:37:59.885190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:59.901055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f488-9f21-4a60-b442-353d3b0b1e2d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:59.906355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:59.913531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:59.913531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:59.913531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:59.913531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:37:59.913531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:59.913531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:37:59.927169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 886/1757] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:37:59.932052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:37:59.946329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e36e9-5f83-4284-b549-e2cb5884d6da None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:37:59.951760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:37:59.952657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:37:59.953013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:37:59.953423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:37:59.954288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:37:59.956228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:00.052614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 872/1758] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:37:59 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:00.057377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:00.083757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b6d85-4530-48f2-a1c1-aa7c7bbb939d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:00.212886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:00.214000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:00.214431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:00.214845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:00.216073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:00.219749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:00.427337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:00.430252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:00.433413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 887/1759] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:00 2022] POST /identity/v3/users => generated 297 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:00.439353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:00.493154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844ef05-e803-4ac6-af33-d05db2c9f2d9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:00.516186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:00.517562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:00.518016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:00.519056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] PATH_INFO: `/v3/projects/465ad1dcfd264bc8bb4e3700667c33a2` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:00.533225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=465ad1dcfd264bc8bb4e3700667c33a2)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:00.535092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4624-54e0-4a30-9d76-87f330126a8c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:00.544417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:00.577247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:00.578707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:00.579412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:00.580620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:00.582160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:00.585485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:00.613043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 888/1760] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:00.618741 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:00.637902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2b811-ff7f-4bde-9a61-a69af67f9402 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:00.643886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:00.644742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:00.645189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:00.645469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:00.646242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:00.649139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:00.668410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 889/1761] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:00.674269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:00.688153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867977-9c91-4ed0-b6df-86b733b16544 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:00.694256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430b6f-c75b-41f8-8d8a-c7964f474b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:00.695587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430b6f-c75b-41f8-8d8a-c7964f474b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:00.695969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430b6f-c75b-41f8-8d8a-c7964f474b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:00.696467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430b6f-c75b-41f8-8d8a-c7964f474b00 admin admin] PATH_INFO: `/v3/projects/3c8607210a3b4dee9a46f958ae0ff8b3/users/f9cbc3a394b84d6d9c56abaf6ae6c275/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:00.727606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e430b6f-c75b-41f8-8d8a-c7964f474b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8607210a3b4dee9a46f958ae0ff8b3, user_id=f9cbc3a394b84d6d9c56abaf6ae6c275, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:00.733282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e430b6f-c75b-41f8-8d8a-c7964f474b00 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:00.909088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 890/1762] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:00 2022] PUT /identity/v3/projects/3c8607210a3b4dee9a46f958ae0ff8b3/users/f9cbc3a394b84d6d9c56abaf6ae6c275/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:00.913042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:00.915363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:00.915685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:00.929165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '465ad1dcfd264bc8bb4e3700667c33a2', 'request_id': 'req-569ff972-61ba-4b3b-a982-93b8f4c8a472'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:00.956454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] MFA Rules not processed for user `f9cbc3a394b84d6d9c56abaf6ae6c275`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:00.957866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:01.034254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 891/1763] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:01.039558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.065874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '465ad1dcfd264bc8bb4e3700667c33a2', 'request_id': 'req-569ff972-61ba-4b3b-a982-93b8f4c8a472'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:01.080372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '465ad1dcfd264bc8bb4e3700667c33a2', 'request_id': 'req-569ff972-61ba-4b3b-a982-93b8f4c8a472'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:01.115067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] The token cache is being invalidate because project 465ad1dcfd264bc8bb4e3700667c33a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:01.115293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:01.116325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-569ff972-61ba-4b3b-a982-93b8f4c8a472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:01.117964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 873/1764] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:00 2022] DELETE /identity/v3/projects/465ad1dcfd264bc8bb4e3700667c33a2 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:01.124616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13102-0e1d-4622-844a-ed6ada748a57 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.124956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13102-0e1d-4622-844a-ed6ada748a57 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.125998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13102-0e1d-4622-844a-ed6ada748a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.130307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7839a65-a5a7-4b82-ba53-7afae60ac5cd None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.137666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.145492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.145974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.146087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.146841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.152504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-fac13102-0e1d-4622-844a-ed6ada748a57 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:01.154145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-fac13102-0e1d-4622-844a-ed6ada748a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:01.154814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.163038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 874/1765] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:01.171998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.172532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.173065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.195861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:01.197166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:01.205337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 875/1766] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:01.210434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.222232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa013a1b-ad54-4bf1-81a4-e33350243e5b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.228540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.229199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.229476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.229745 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.230568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:01.231133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.232783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.245937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 876/1767] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:38:01.251597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.263020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b6349-5a4f-4024-9edb-aa5a42991c9b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.267822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.268494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.268775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.269054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.269809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.271867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.393699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 892/1768] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:01 2022] POST /identity/v3/projects => generated 393 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:01.397590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.400016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:01.440306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 877/1769] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:01.447352 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.494314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba09c92-c205-4a92-ad64-d502522200ed admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.569082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b981b-e6b1-441b-8fd5-673de8f40e71 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.586983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.589018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.589325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.589600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.591971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.597043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.611114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.611947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.612237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.612573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.613786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.620219 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.775029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 893/1770] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:01 2022] POST /identity/v3/users => generated 303 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:01.776063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.776741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 878/1771] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:01 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:01.777888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.801041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b18c-cd4c-412a-b484-a265ca75c7be admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.802401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a710-b05f-4285-a439-745e51f8cfcb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.811893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.814271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.815437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.816011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.816458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.817970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.819058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.819703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.821237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.824003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.825761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.830629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.857794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 894/1772] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:01.859118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.861827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 879/1773] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:01.867662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.884828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa286947-e48a-4327-b5f2-987e82dbbffa admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.889233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80933b6f-e996-4173-b4c8-20317c092b58 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.896775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.899939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.901103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.902121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] PATH_INFO: `/v3/projects/fc222a524a5e4dba835e028cbedf0ca6/users/90e51c32ad034a4fa5f5102d57648e43/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.904460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.908777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.908777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.908777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:01.908777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.911414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.938718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 880/1774] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:01.945425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:01.952887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc222a524a5e4dba835e028cbedf0ca6, user_id=90e51c32ad034a4fa5f5102d57648e43, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:01.955804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:01.958121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdab24-dd7d-482f-986a-32ec853fb9d2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:01.966295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a74d-a777-499a-a2d5-a67a5ed2eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:01.966295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a74d-a777-499a-a2d5-a67a5ed2eb02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:01.966929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a74d-a777-499a-a2d5-a67a5ed2eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:01.967295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a74d-a777-499a-a2d5-a67a5ed2eb02 admin admin] PATH_INFO: `/v3/projects/c835aeb7013445ba8ca5f0bba85bf59d/users/d5081eaa866c4ef8a5ba642046c7f75c/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.014604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650a74d-a777-499a-a2d5-a67a5ed2eb02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c835aeb7013445ba8ca5f0bba85bf59d, user_id=d5081eaa866c4ef8a5ba642046c7f75c, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:02.021028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650a74d-a777-499a-a2d5-a67a5ed2eb02 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:02.100084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 895/1775] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:01 2022] PUT /identity/v3/projects/fc222a524a5e4dba835e028cbedf0ca6/users/90e51c32ad034a4fa5f5102d57648e43/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:02.105998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:02.207812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bc864-5909-4735-8f13-9e0e65580903 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:02.214067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:02.214827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:02.215145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:02.215427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.216224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:02.218126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:02.232500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 896/1776] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:02.237085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:02.253611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab009ab-678f-41d7-8ad9-7a5ad7656528 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:02.263878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9a2ce-056e-4010-bc94-59c71749185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:02.265649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9a2ce-056e-4010-bc94-59c71749185a admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:02.266303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9a2ce-056e-4010-bc94-59c71749185a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:02.266892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9a2ce-056e-4010-bc94-59c71749185a admin admin] PATH_INFO: `/v3/projects/fc222a524a5e4dba835e028cbedf0ca6/users/90e51c32ad034a4fa5f5102d57648e43/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.270168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9a2ce-056e-4010-bc94-59c71749185a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc222a524a5e4dba835e028cbedf0ca6, user_id=90e51c32ad034a4fa5f5102d57648e43, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:02.274648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9a2ce-056e-4010-bc94-59c71749185a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:02.286658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 897/1777] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:02 2022] PUT /identity/v3/projects/fc222a524a5e4dba835e028cbedf0ca6/users/90e51c32ad034a4fa5f5102d57648e43/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:02.298196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 881/1778] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:01 2022] PUT /identity/v3/projects/c835aeb7013445ba8ca5f0bba85bf59d/users/d5081eaa866c4ef8a5ba642046c7f75c/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:02.303665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:02.303665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:02.304226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.310624 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:02.311255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:02.311749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.345092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] MFA Rules not processed for user `d5081eaa866c4ef8a5ba642046c7f75c`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:02.346783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:02.385420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] MFA Rules not processed for user `90e51c32ad034a4fa5f5102d57648e43`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:02.387609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:02.478954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 882/1779] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:02.480633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:02.619458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 898/1780] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:02.623379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:02.625410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:02.677825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2b0bd-d54d-45af-a425-f17334b9bbe3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:02.689275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:02.689875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:02.690576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:02.690576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.695925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:02.696990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:02.759800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f10b64-30a6-4aac-a59e-ea9f372a0f96 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:02.766467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:02.767473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:02.767875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:02.768370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:02.782003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:02.784171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:02.801755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 899/1781] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:38:02.859065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 883/1782] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:02 2022] POST /identity/v3/projects => generated 385 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:02.872043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:02.879789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:02.892398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:02.892650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d66a16-b909-4b74-a72d-c9e9624719b1 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:03.027267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:03.029286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:03.029909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d86249-013e-4963-849a-4519f5eb1e3c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:03.030700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:03.031073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:03.033681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:03.051711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:03.052415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:03.052773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:03.053045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:03.053168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:03.056380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:03.200707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:03.200707 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:03.208441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 884/1783] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:03.251321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 900/1784] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:02 2022] POST /identity/v3/users => generated 299 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:03.265121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:03.279366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6683cf-2d48-499c-a6a4-eda4d4648995 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:03.318454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:03.321593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:03.321901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:03.322183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:03.322993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:03.333601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:03.365489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 885/1785] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:03.371129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:03.384720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347ffc2-794c-4fa7-872f-c14b6c97df8d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:03.392572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:03.399891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:03.399891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:03.399891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] PATH_INFO: `/v3/projects/044d181af4ca46a5aa9547701cb94ec5/users/2f8e92169f5140519cb490fc6e78e963/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:03.419599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044d181af4ca46a5aa9547701cb94ec5, user_id=2f8e92169f5140519cb490fc6e78e963, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:03.425717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:03.646832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 901/1786] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:03 2022] PUT /identity/v3/projects/044d181af4ca46a5aa9547701cb94ec5/users/2f8e92169f5140519cb490fc6e78e963/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:03.651920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:03.679912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34676b1-445e-43fe-985d-bb5e57b0a4c7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:03.890951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b93409-71f5-4ee2-a5a0-c9eab703e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:03.894628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93409-71f5-4ee2-a5a0-c9eab703e93c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:03.895108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93409-71f5-4ee2-a5a0-c9eab703e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:03.895588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b93409-71f5-4ee2-a5a0-c9eab703e93c admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:03.898463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b93409-71f5-4ee2-a5a0-c9eab703e93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:03.903139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b93409-71f5-4ee2-a5a0-c9eab703e93c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:03.946269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:03.956615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 886/1787] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:03.966690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80deb5-59b5-4a51-9658-d058b3bf3fe1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:03.976637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:03.977598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:03.977881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:03.978157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] PATH_INFO: `/v3/projects/044d181af4ca46a5aa9547701cb94ec5/users/2f8e92169f5140519cb490fc6e78e963/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:03.981459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044d181af4ca46a5aa9547701cb94ec5, user_id=2f8e92169f5140519cb490fc6e78e963, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:03.984822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:04.007874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 902/1788] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:03 2022] PUT /identity/v3/projects/044d181af4ca46a5aa9547701cb94ec5/users/2f8e92169f5140519cb490fc6e78e963/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:04.030723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046a06c-fd3a-4fb9-9259-e5f694fcf702 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:04.031272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046a06c-fd3a-4fb9-9259-e5f694fcf702 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:04.031633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046a06c-fd3a-4fb9-9259-e5f694fcf702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:04.101765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0046a06c-fd3a-4fb9-9259-e5f694fcf702 None None] MFA Rules not processed for user `2f8e92169f5140519cb490fc6e78e963`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:04.104263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0046a06c-fd3a-4fb9-9259-e5f694fcf702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:04.298467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 887/1789] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:04.311235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:04.431485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3512a3-bd1a-40ad-a9fa-5bcd33b4eac8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:04.436033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5523f-f170-4579-a60f-543e22ffb6f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:04.437363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5523f-f170-4579-a60f-543e22ffb6f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:04.437708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5523f-f170-4579-a60f-543e22ffb6f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:04.438083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5523f-f170-4579-a60f-543e22ffb6f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:04.553929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5523f-f170-4579-a60f-543e22ffb6f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:04.555948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5523f-f170-4579-a60f-543e22ffb6f8 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:04.572263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 903/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:07.373515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991a25-bc42-4970-bf45-1346e6d6bb82 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:07.373989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991a25-bc42-4970-bf45-1346e6d6bb82 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:07.374079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1991a25-bc42-4970-bf45-1346e6d6bb82 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:07.376058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 888/1791] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:38:07.394024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:07.396011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:07.397057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:07.432556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:07.434021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:07.588426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 904/1792] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:07.952885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1991a25-bc42-4970-bf45-1346e6d6bb82 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:07.956342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b1991a25-bc42-4970-bf45-1346e6d6bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:08.001895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1991a25-bc42-4970-bf45-1346e6d6bb82 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:08.009478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:08.014330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:08.014330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:08.014330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:08.022731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:08.024819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:08.036836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 889/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:14.824448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:14.834199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4664-353b-4bc9-bc50-6343682066d0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:14.838428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492abd-1718-4f32-9312-1a233701bef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:14.839360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492abd-1718-4f32-9312-1a233701bef3 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:14.839474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492abd-1718-4f32-9312-1a233701bef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:14.839658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492abd-1718-4f32-9312-1a233701bef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:14.849621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492abd-1718-4f32-9312-1a233701bef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:14.851125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492abd-1718-4f32-9312-1a233701bef3 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:14.862050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 905/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:16.355151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:16.423092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1aea-032f-451d-a423-f9a443d546b4 service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:16.429728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:16.430661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:16.430939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:16.431212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] PATH_INFO: `/v3/users/f9cbc3a394b84d6d9c56abaf6ae6c275` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:16.432588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cbc3a394b84d6d9c56abaf6ae6c275)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:16.434579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:16.741131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cbc3a394b84d6d9c56abaf6ae6c275'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:16.768383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cbc3a394b84d6d9c56abaf6ae6c275'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:16.769133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cbc3a394b84d6d9c56abaf6ae6c275'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:16.779149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cbc3a394b84d6d9c56abaf6ae6c275'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:16.937749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cbc3a394b84d6d9c56abaf6ae6c275'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:16.953533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 890/1795] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:16 2022] DELETE /identity/v3/users/f9cbc3a394b84d6d9c56abaf6ae6c275 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:16.958808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:16.959398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:16.960836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:17.000041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:17.002114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:17.096568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 906/1796] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:17.113727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:17.117698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:17.205785 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adba7c-20df-4bf6-9a0e-a6833636d8fd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:17.210093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:17.210814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:17.211100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:17.211375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:17.224393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:17.226277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:17.240580 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 891/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:17.973951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:17.976775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:18.021169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6476ae3-fc51-43d4-b16d-464578ea628a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:18.031520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:18.033993 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:18.034822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:18.035306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] PATH_INFO: `/v3/projects/3c8607210a3b4dee9a46f958ae0ff8b3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:18.037670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8607210a3b4dee9a46f958ae0ff8b3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:18.041503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:18.230000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8607210a3b4dee9a46f958ae0ff8b3', 'request_id': 'req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.369156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8607210a3b4dee9a46f958ae0ff8b3', 'request_id': 'req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.376242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8607210a3b4dee9a46f958ae0ff8b3', 'request_id': 'req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.390611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] The token cache is being invalidate because project 3c8607210a3b4dee9a46f958ae0ff8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:18.390964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.391585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.393236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 907/1798] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:17 2022] DELETE /identity/v3/projects/3c8607210a3b4dee9a46f958ae0ff8b3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:18.398496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:18.409896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b26d43-0051-4494-8955-854d995983c0 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:18.474123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:18.475095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:18.475473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:18.475901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] PATH_INFO: `/v3/users/90e51c32ad034a4fa5f5102d57648e43` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:18.477325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e51c32ad034a4fa5f5102d57648e43)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:18.479368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:18.882303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e51c32ad034a4fa5f5102d57648e43'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.894975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e51c32ad034a4fa5f5102d57648e43'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.895733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e51c32ad034a4fa5f5102d57648e43'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:18.915095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e51c32ad034a4fa5f5102d57648e43'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:19.176344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ffc25960-3b84-4216-a773-f243ba01921b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e51c32ad034a4fa5f5102d57648e43'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:19.187922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 892/1799] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:18 2022] DELETE /identity/v3/users/90e51c32ad034a4fa5f5102d57648e43 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:19.841753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:19.843245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:19.857268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85756b2-34ed-428c-a4f5-0c1e39d9ed23 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:19.956258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:19.957572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:19.958168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:19.958776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] PATH_INFO: `/v3/projects/fc222a524a5e4dba835e028cbedf0ca6` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:19.962146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc222a524a5e4dba835e028cbedf0ca6)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:19.964979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:20.169791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc222a524a5e4dba835e028cbedf0ca6', 'request_id': 'req-8beec0f6-4494-4927-b4dd-65a0d1d4e690'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:20.306821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc222a524a5e4dba835e028cbedf0ca6', 'request_id': 'req-8beec0f6-4494-4927-b4dd-65a0d1d4e690'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:20.323447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc222a524a5e4dba835e028cbedf0ca6', 'request_id': 'req-8beec0f6-4494-4927-b4dd-65a0d1d4e690'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:20.341663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] The token cache is being invalidate because project fc222a524a5e4dba835e028cbedf0ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:20.342163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:20.343153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8beec0f6-4494-4927-b4dd-65a0d1d4e690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:20.351893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 908/1800] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:19 2022] DELETE /identity/v3/projects/fc222a524a5e4dba835e028cbedf0ca6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:20.353814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:20.354614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:20.354614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:20.379270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:20.380749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:20.465909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 893/1801] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:20.473717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:20.474194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:20.474678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:20.505966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:20.508451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:20.520273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 909/1802] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:20.528720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:20.540554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aeced-d9b7-469c-937e-c8f23f4caa06 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:20.545970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:20.546703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:20.546976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:20.547248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:20.548056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:20.548360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:20.550080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:20.565234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 894/1803] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:38:20.572165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:20.581686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d10211-9546-4825-8e04-b2017779bb1c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:20.587400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:20.588074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:20.588353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:20.588623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:20.589345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:20.591360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:20.825012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 910/1804] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:20 2022] POST /identity/v3/projects => generated 407 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:20.828893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:20.839368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79efec-61b9-4086-826a-b9520ab98eda admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:20.907229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:20.907910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:20.908341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:20.908623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:20.909338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:20.911382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:21.144591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:21.145084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 895/1805] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:20 2022] POST /identity/v3/users => generated 304 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:21.155982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca00dfa-1700-41d8-816a-b85406544051 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:21.162557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:21.164137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:21.164644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:21.164918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:21.165830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:21.168918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:21.190749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 911/1806] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:21.193535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:21.215525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426b5e-3ee5-4df4-846e-85c11c3ebd67 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:21.222298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abc49e-3548-4179-8071-a47afbd65733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:21.222974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abc49e-3548-4179-8071-a47afbd65733 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:21.223428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abc49e-3548-4179-8071-a47afbd65733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:21.223706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abc49e-3548-4179-8071-a47afbd65733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:21.224538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abc49e-3548-4179-8071-a47afbd65733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:21.227306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abc49e-3548-4179-8071-a47afbd65733 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:21.240736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 896/1807] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:21.246442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:21.257962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8839f-1564-47c6-a2f2-cf800bf1cde1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:21.263571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:21.264802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:21.264980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:21.265260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] PATH_INFO: `/v3/projects/871fc8e059df45b39ad8aa1354964d1c/users/e7dd2dee66e34f01bf9869536099ae34/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:21.289320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=871fc8e059df45b39ad8aa1354964d1c, user_id=e7dd2dee66e34f01bf9869536099ae34, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:21.292255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:21.388120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 912/1808] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:21 2022] PUT /identity/v3/projects/871fc8e059df45b39ad8aa1354964d1c/users/e7dd2dee66e34f01bf9869536099ae34/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:21.401149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:21.401734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:21.401734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:21.438094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] MFA Rules not processed for user `e7dd2dee66e34f01bf9869536099ae34`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:21.439652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:21.536663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 897/1809] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:21.540706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:21.623439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419259ab-2ef2-45c2-b876-8f48fa201b7c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:21.628348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:21.629078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:21.629359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:21.629688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:21.630446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:21.632786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:21.852741 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 913/1810] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:21 2022] POST /identity/v3/projects => generated 409 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:21.854828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:21.869429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8772e5-8cb4-4f6e-af30-99ee6c6c3926 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:21.932525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:21.933204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:21.933488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:21.933764 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:21.934514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:21.936460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:22.153645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 898/1811] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:21 2022] POST /identity/v3/users => generated 311 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:22.157960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:22.169441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6ea82-eb39-47fd-8490-ba0e77fbc90b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:22.174417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:22.175085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:22.175365 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:22.175645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:22.176690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:22.178355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:22.222797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 914/1812] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:22.224193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:22.238194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df08d6-44ca-4045-9b22-5bcfdbd4a6dd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:22.244597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:22.245726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:22.246011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:22.246320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] PATH_INFO: `/v3/projects/489aff28f60845f3a32e36013fec79cb/users/3451e0626e48491395b98eada40fffa2/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:22.263838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=489aff28f60845f3a32e36013fec79cb, user_id=3451e0626e48491395b98eada40fffa2, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:22.266845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:22.423721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 899/1813] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:22 2022] PUT /identity/v3/projects/489aff28f60845f3a32e36013fec79cb/users/3451e0626e48491395b98eada40fffa2/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:22.428212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:22.439226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda921a-4424-43f2-9a93-d80775893fb8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:22.502937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4e791-34ac-47d0-998e-1bc9f1faf996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:22.503723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e791-34ac-47d0-998e-1bc9f1faf996 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:22.506345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e791-34ac-47d0-998e-1bc9f1faf996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:22.506345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e791-34ac-47d0-998e-1bc9f1faf996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:22.506345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4e791-34ac-47d0-998e-1bc9f1faf996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:22.522451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4e791-34ac-47d0-998e-1bc9f1faf996 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:22.522451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 915/1814] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:22.523761 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:22.537551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b49d-9f4a-457b-bf8e-6a730e998cea admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:22.542663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:22.543570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:22.543823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:22.544087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] PATH_INFO: `/v3/projects/489aff28f60845f3a32e36013fec79cb/users/3451e0626e48491395b98eada40fffa2/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:22.546080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=489aff28f60845f3a32e36013fec79cb, user_id=3451e0626e48491395b98eada40fffa2, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:22.548755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:22.571599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 900/1815] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:22 2022] PUT /identity/v3/projects/489aff28f60845f3a32e36013fec79cb/users/3451e0626e48491395b98eada40fffa2/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:22.593538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:22.593824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:22.594309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:22.647569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] MFA Rules not processed for user `3451e0626e48491395b98eada40fffa2`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:22.648832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:22.750104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 916/1816] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:22 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:22.782878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:22.785044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:22.844352 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28636-2391-4866-b527-29199ae759cb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:22.848179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:22.848845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:22.849126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:22.849399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:22.859456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:22.860893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:22.871318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 901/1817] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:22 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:23.768773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:23.773004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:23.845515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:23.859484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0cdda-4af1-4fc7-a772-302bddc183da service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:23.870093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e50b65-c277-477f-bc17-ad29350961b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:23.870093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50b65-c277-477f-bc17-ad29350961b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:23.870093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50b65-c277-477f-bc17-ad29350961b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:23.870093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e50b65-c277-477f-bc17-ad29350961b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:23.878717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf3d9-497d-4fdf-a3b5-261176576022 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:23.884478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:23.885451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:23.885742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:23.886022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] PATH_INFO: `/v3/users/d5081eaa866c4ef8a5ba642046c7f75c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:23.887518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5081eaa866c4ef8a5ba642046c7f75c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:23.889777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:23.956908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e50b65-c277-477f-bc17-ad29350961b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:23.958514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e50b65-c277-477f-bc17-ad29350961b4 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:23.969804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 902/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:38:24.232204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5081eaa866c4ef8a5ba642046c7f75c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:24.239818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5081eaa866c4ef8a5ba642046c7f75c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:24.240780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5081eaa866c4ef8a5ba642046c7f75c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:24.245873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5081eaa866c4ef8a5ba642046c7f75c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:24.260419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5081eaa866c4ef8a5ba642046c7f75c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:24.523859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 917/1819] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:23 2022] DELETE /identity/v3/users/d5081eaa866c4ef8a5ba642046c7f75c => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:24.525419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:24.525805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:24.526083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:24.546239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:24.547496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:24.617836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 903/1820] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:24.624480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:24.627393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:24.730723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67879a-c5a7-4f31-a25a-9cbe48e923fd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:24.734822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:24.735561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:24.735784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:24.736079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:24.777305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:24.777305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:24.780684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 918/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:25.685997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:25.688981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:25.710902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ce192-fc14-4a72-aca5-1e762cfb9ba9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:25.719731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:25.721716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:25.722357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:25.723020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] PATH_INFO: `/v3/projects/c835aeb7013445ba8ca5f0bba85bf59d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:25.725956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c835aeb7013445ba8ca5f0bba85bf59d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:25.732558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:25.906605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c835aeb7013445ba8ca5f0bba85bf59d', 'request_id': 'req-2ef29410-5dad-43b3-ab93-112c1bb29da3'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.050956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c835aeb7013445ba8ca5f0bba85bf59d', 'request_id': 'req-2ef29410-5dad-43b3-ab93-112c1bb29da3'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.062547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c835aeb7013445ba8ca5f0bba85bf59d', 'request_id': 'req-2ef29410-5dad-43b3-ab93-112c1bb29da3'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.078565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] The token cache is being invalidate because project c835aeb7013445ba8ca5f0bba85bf59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:26.078953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.079737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.081720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 904/1822] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:25 2022] DELETE /identity/v3/projects/c835aeb7013445ba8ca5f0bba85bf59d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:26.093166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:26.114988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29bac-5951-4254-bb77-b18d679a5c60 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:26.210375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:26.211891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:26.212356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:26.212728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] PATH_INFO: `/v3/users/2f8e92169f5140519cb490fc6e78e963` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:26.215933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8e92169f5140519cb490fc6e78e963)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:26.219014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:26.539577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8e92169f5140519cb490fc6e78e963'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.562903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8e92169f5140519cb490fc6e78e963'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.563676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8e92169f5140519cb490fc6e78e963'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.564470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8e92169f5140519cb490fc6e78e963'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.579446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2666f7ca-9e7a-4f4e-9824-df5cffea4ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8e92169f5140519cb490fc6e78e963'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:26.851884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 919/1823] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:26 2022] DELETE /identity/v3/users/2f8e92169f5140519cb490fc6e78e963 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:28.040160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:28.042385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:28.060817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef29410-5dad-43b3-ab93-112c1bb29da3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:28.133313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:28.140477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:28.140477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:28.140477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] PATH_INFO: `/v3/projects/044d181af4ca46a5aa9547701cb94ec5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:28.140477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044d181af4ca46a5aa9547701cb94ec5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:28.140477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:28.337175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044d181af4ca46a5aa9547701cb94ec5', 'request_id': 'req-b7c074d2-d714-4eb4-a3bc-297dae934df3'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:28.477883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044d181af4ca46a5aa9547701cb94ec5', 'request_id': 'req-b7c074d2-d714-4eb4-a3bc-297dae934df3'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:28.486883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044d181af4ca46a5aa9547701cb94ec5', 'request_id': 'req-b7c074d2-d714-4eb4-a3bc-297dae934df3'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:28.504450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] The token cache is being invalidate because project 044d181af4ca46a5aa9547701cb94ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:28.505151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:28.506000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b7c074d2-d714-4eb4-a3bc-297dae934df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:28.524727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 905/1824] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:28 2022] DELETE /identity/v3/projects/044d181af4ca46a5aa9547701cb94ec5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:28.525392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:28.525392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:28.525392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:28.537543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:28.538854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:28.606167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 920/1825] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:28.615664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:28.615963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:28.616309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:28.637451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:28.643364 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:28.647478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 906/1826] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:28.652088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:28.661896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c49f-df4a-4468-8825-35ed18c22a1a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:28.667434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:28.668116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:28.668421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:28.669092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:28.670031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:28.670382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:28.672045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:28.685560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 921/1827] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:38:28.690192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:28.699737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f82984-6d4a-4d8e-8bfe-e05bf30a06bc None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:28.704500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:28.705172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:28.705469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:28.705891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:28.706652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:28.708587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:28.944363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 907/1828] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:28 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:28.945869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:28.956062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e289e-6df7-42ad-a31e-34fc3355351a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:29.014684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:29.015350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:29.015627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:29.015929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:29.016633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:29.020096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:29.132163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 922/1829] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:28 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:29.136609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:29.149017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc333a2-6428-4dad-823e-612b9e24e28d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:29.155234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:29.155901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:29.156286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:29.156559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:29.157304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:29.159224 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:29.172603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 908/1830] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:29.176662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:29.187146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5b97-6fa3-4497-90f8-100fe0300a7c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:29.191972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f7dc-0638-4b07-ac87-debf649a0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:29.192643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f7dc-0638-4b07-ac87-debf649a0466 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:29.192926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f7dc-0638-4b07-ac87-debf649a0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:29.193201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f7dc-0638-4b07-ac87-debf649a0466 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:29.193946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f7dc-0638-4b07-ac87-debf649a0466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:29.195920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f7dc-0638-4b07-ac87-debf649a0466 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:29.217202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 923/1831] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:29.218648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:29.229659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96bdd-2657-4431-bcb5-60fe7e908a75 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:29.235146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:29.236150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:29.236501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:29.236844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] PATH_INFO: `/v3/projects/3f9a1e4405624fddb7b74f8ac99219a5/users/4e245818481a4d4ea5264c9b019cb09f/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:29.252892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9a1e4405624fddb7b74f8ac99219a5, user_id=4e245818481a4d4ea5264c9b019cb09f, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:29.255823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:29.365170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 909/1832] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:29 2022] PUT /identity/v3/projects/3f9a1e4405624fddb7b74f8ac99219a5/users/4e245818481a4d4ea5264c9b019cb09f/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:29.376613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5bb11-fbc2-43f5-953a-4d89035576dc None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:29.382637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5bb11-fbc2-43f5-953a-4d89035576dc None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:29.382637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5bb11-fbc2-43f5-953a-4d89035576dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:29.411534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-74c5bb11-fbc2-43f5-953a-4d89035576dc None None] MFA Rules not processed for user `4e245818481a4d4ea5264c9b019cb09f`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:29.413093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-74c5bb11-fbc2-43f5-953a-4d89035576dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:29.493202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 924/1833] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:29.503238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:29.504958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:29.571402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9452-daed-440a-8126-8e39e1d7ecf9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:29.574028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:29.574758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:29.575047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:29.575680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:29.594302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:29.596967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:29.611527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 910/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:36.864465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:36.865383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:36.865383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:36.884034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] MFA Rules not processed for user `b6431c85b6c74608aae42e0e856d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:36.885788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:36.947557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 925/1835] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:38.572066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:38.715020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6847-3ae1-4fed-8372-b4d7b7e31386 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:38.727137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:38.728751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:38.729266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:38.734148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] PATH_INFO: `/v3/users/4e245818481a4d4ea5264c9b019cb09f` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:38.734148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e245818481a4d4ea5264c9b019cb09f)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:38.736452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:38.848246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:38.849695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:38.872205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f49d6f-d8b1-4a17-8750-0072e1933ba4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:38.881297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:38.884253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:38.884764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:38.885247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] PATH_INFO: `/v3/users/02c8aa90fc124ff2933e46c9166d5f3e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:38.889225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c8aa90fc124ff2933e46c9166d5f3e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:38.892030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:39.103179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e245818481a4d4ea5264c9b019cb09f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.124480 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e245818481a4d4ea5264c9b019cb09f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.125442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e245818481a4d4ea5264c9b019cb09f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.136706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e245818481a4d4ea5264c9b019cb09f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.208073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c8aa90fc124ff2933e46c9166d5f3e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.215470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c8aa90fc124ff2933e46c9166d5f3e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.216211 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c8aa90fc124ff2933e46c9166d5f3e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.216927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c8aa90fc124ff2933e46c9166d5f3e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.229287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6fe5f352-0396-40a3-9933-0ad15011f989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c8aa90fc124ff2933e46c9166d5f3e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.239299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3d0f8dbe-4d39-4330-90ff-ec86f7615f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e245818481a4d4ea5264c9b019cb09f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:39.251399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 911/1836] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:38 2022] DELETE /identity/v3/users/4e245818481a4d4ea5264c9b019cb09f => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:39.256068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:39.256409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:39.256721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:39.275159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:39.276357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:39.337422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 912/1837] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:39.347786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:39.349351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:39.399234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 926/1838] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:38 2022] DELETE /identity/v3/users/02c8aa90fc124ff2933e46c9166d5f3e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:39.408405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b163a-dc65-4ff1-afef-12bf24ec68d8 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:39.417847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:39.418353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:39.418810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:39.446951 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:39.448849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:39.472379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:39.473139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:39.473490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:39.473846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:39.540693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 927/1839] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:39.560950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:39.572737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:39.575036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:39.579750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e38b9-98d1-4e95-b8c1-ce6ddd891d95 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:39.587299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff1136-10ae-4ad5-89e9-877b4ae67899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:39.588738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff1136-10ae-4ad5-89e9-877b4ae67899 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:39.589234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff1136-10ae-4ad5-89e9-877b4ae67899 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:39.589694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff1136-10ae-4ad5-89e9-877b4ae67899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:39.591904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 913/1840] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:38:39.609279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff1136-10ae-4ad5-89e9-877b4ae67899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:39.612255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff1136-10ae-4ad5-89e9-877b4ae67899 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:39.631427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 928/1841] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:39.953389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:39.956028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:39.988398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d170f-f208-440a-9422-094eb0181fd1 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:39.997995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:39.999566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:40.000027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:40.000463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] PATH_INFO: `/v3/users/e7dd2dee66e34f01bf9869536099ae34` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:40.003222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7dd2dee66e34f01bf9869536099ae34)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:40.007448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:40.479450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7dd2dee66e34f01bf9869536099ae34'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:40.512857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7dd2dee66e34f01bf9869536099ae34'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:40.514254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7dd2dee66e34f01bf9869536099ae34'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:40.528750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7dd2dee66e34f01bf9869536099ae34'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:40.678108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7dd2dee66e34f01bf9869536099ae34'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:40.685447 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 914/1842] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:39 2022] DELETE /identity/v3/users/e7dd2dee66e34f01bf9869536099ae34 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:40.690312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:40.691119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:40.691260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:40.712558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:40.713821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:40.730835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:40.733168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:40.794460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 929/1843] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:40.805318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:40.806837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:40.829049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373f1e4-a389-40c2-bcf8-c15527a3d9f5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:40.834105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:40.835897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:40.836185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:40.836460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] PATH_INFO: `/v3/projects/3f9a1e4405624fddb7b74f8ac99219a5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:40.837695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9a1e4405624fddb7b74f8ac99219a5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:40.839653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:40.878130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81859e06-568c-43d3-9e4f-591864b74eff None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:40.882656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:40.883488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:40.883890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:40.884165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:40.907350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:40.908709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:40.923849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 930/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:38:40.924708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:40.926051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:40.946378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915b589-67f3-49a4-839c-c94e7f042d52 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:40.953759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:40.954671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:40.954981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:40.955260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] PATH_INFO: `/v3/projects/23cef35cb33443858942522019b51ea9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:40.957032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23cef35cb33443858942522019b51ea9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:40.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:41.021095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9a1e4405624fddb7b74f8ac99219a5', 'request_id': 'req-4bfa5e93-c1c2-4921-b337-f24722c2b266'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.136697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23cef35cb33443858942522019b51ea9', 'request_id': 'req-a4bdba25-d441-409a-806b-6b86f7aa004c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.193802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9a1e4405624fddb7b74f8ac99219a5', 'request_id': 'req-4bfa5e93-c1c2-4921-b337-f24722c2b266'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.206392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9a1e4405624fddb7b74f8ac99219a5', 'request_id': 'req-4bfa5e93-c1c2-4921-b337-f24722c2b266'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.232136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] The token cache is being invalidate because project 3f9a1e4405624fddb7b74f8ac99219a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:41.232810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.234781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4bfa5e93-c1c2-4921-b337-f24722c2b266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.238882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 915/1845] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:40 2022] DELETE /identity/v3/projects/3f9a1e4405624fddb7b74f8ac99219a5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:41.248251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:41.248790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:41.249217 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:41.279451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:41.281673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:41.341982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23cef35cb33443858942522019b51ea9', 'request_id': 'req-a4bdba25-d441-409a-806b-6b86f7aa004c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.353682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23cef35cb33443858942522019b51ea9', 'request_id': 'req-a4bdba25-d441-409a-806b-6b86f7aa004c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.373008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 916/1846] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:41.382580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] The token cache is being invalidate because project 23cef35cb33443858942522019b51ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:41.382580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.382580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a4bdba25-d441-409a-806b-6b86f7aa004c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.386502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:41.387000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 931/1847] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:40 2022] DELETE /identity/v3/projects/23cef35cb33443858942522019b51ea9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:41.392029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:41.401401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:41.403051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:41.403439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:41.424589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903fa54-31f8-49e5-a3a3-10aa47b4813e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:41.431829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:41.432970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:41.433249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:41.433608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] PATH_INFO: `/v3/users/29bd67fd9ac64f57acbf9d9492731655` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:41.436332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bd67fd9ac64f57acbf9d9492731655)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:41.439721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:41.448535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:41.450113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:41.462853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 932/1848] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:41.470543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:41.486719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a5e6-92ac-4238-944f-859c4e68668c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:41.497356 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:41.498904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:41.498904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:41.501896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:41.501896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:41.501896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:41.504468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:41.523588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 933/1849] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:38:41.530340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:41.549280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c9da-9b6c-4d3c-bc71-d1356e2472fc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:41.555580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:41.556265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:41.556542 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:41.556812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:41.557518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:41.559549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:41.746325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 934/1850] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:41 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:41.747895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:41.750563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:41.756211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bd67fd9ac64f57acbf9d9492731655'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.772002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bd67fd9ac64f57acbf9d9492731655'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.772842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bd67fd9ac64f57acbf9d9492731655'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.781657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bd67fd9ac64f57acbf9d9492731655'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.831606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f957-0c54-4b8c-853f-fede8a07baea admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:41.836718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:41.837577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:41.837859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:41.838143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] PATH_INFO: `/v3/projects/871fc8e059df45b39ad8aa1354964d1c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:41.839504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] RBAC: Authorizing `identity:delete_project(project_id=871fc8e059df45b39ad8aa1354964d1c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:41.841424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:41.970307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bd67fd9ac64f57acbf9d9492731655'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:41.979754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 917/1851] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:41 2022] DELETE /identity/v3/users/29bd67fd9ac64f57acbf9d9492731655 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:41.980599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:41.982673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:42.049882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871fc8e059df45b39ad8aa1354964d1c', 'request_id': 'req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.100237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6d99a-50be-4854-835c-2a9d97c399f2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:42.199613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:42.200626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:42.201066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:42.201513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:42.202619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:42.205559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:42.283923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871fc8e059df45b39ad8aa1354964d1c', 'request_id': 'req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.295491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871fc8e059df45b39ad8aa1354964d1c', 'request_id': 'req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.319831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] The token cache is being invalidate because project 871fc8e059df45b39ad8aa1354964d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:42.320319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.321431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.324120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 935/1852] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:41 2022] DELETE /identity/v3/projects/871fc8e059df45b39ad8aa1354964d1c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:42.329695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:42.332146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:42.353785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab221e64-fdc9-4728-bb86-d2c5dfb4067f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:42.360102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:42.361137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:42.361511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:42.361909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] PATH_INFO: `/v3/users/3451e0626e48491395b98eada40fffa2` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:42.363458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3451e0626e48491395b98eada40fffa2)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:42.368396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:42.457416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 918/1853] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:41 2022] POST /identity/v3/users => generated 292 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:42.462469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:42.464324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:42.477839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894eec7-04a1-49f6-919a-ca00f3b4898d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:42.483013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:42.483685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:42.483965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:42.484236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:42.484987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:42.486668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:42.497904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 919/1854] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:42.503313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:42.516132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe203a7-c4cb-4522-a4d6-d38582cb2099 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:42.524538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:42.524538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:42.524538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:42.524538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:42.525147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:42.526736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:42.540731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 920/1855] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:42.544910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:42.556471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2df52-29b9-4f95-8746-6573405abbe4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:42.578755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee00eee-e1c7-4977-a66d-46844184313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:42.579675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00eee-e1c7-4977-a66d-46844184313f admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:42.579958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00eee-e1c7-4977-a66d-46844184313f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:42.580233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee00eee-e1c7-4977-a66d-46844184313f admin admin] PATH_INFO: `/v3/projects/d463bd1303c5402e852f801706e13a08/users/e13bb44cdd144ca3bc845d65b94d76b4/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:42.615251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee00eee-e1c7-4977-a66d-46844184313f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d463bd1303c5402e852f801706e13a08, user_id=e13bb44cdd144ca3bc845d65b94d76b4, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:42.618182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee00eee-e1c7-4977-a66d-46844184313f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:42.760664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 921/1856] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:42 2022] PUT /identity/v3/projects/d463bd1303c5402e852f801706e13a08/users/e13bb44cdd144ca3bc845d65b94d76b4/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:42.771646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:42.771911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:42.772200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:42.782622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3451e0626e48491395b98eada40fffa2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.797348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3451e0626e48491395b98eada40fffa2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.798794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3451e0626e48491395b98eada40fffa2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.800200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3451e0626e48491395b98eada40fffa2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.829997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3451e0626e48491395b98eada40fffa2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:42.839946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] MFA Rules not processed for user `e13bb44cdd144ca3bc845d65b94d76b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:42.841207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:42.931693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 922/1857] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:42.942428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:42.943924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:42.998693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 936/1858] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:42 2022] DELETE /identity/v3/users/3451e0626e48491395b98eada40fffa2 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:42.998693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:43.002619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:43.047966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8198d-abaf-4985-9eba-cddd642a5ca2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:43.126903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f77b-675c-4d68-9fd3-4cd2fdf401b7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:43.135489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:43.136754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.137145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.137888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] PATH_INFO: `/v3/projects/9f8d6323a6bd4739a1c866f2e164934f` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.139443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8d6323a6bd4739a1c866f2e164934f)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:43.139947 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4445b-0bdf-4f46-893b-62484f0c7ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:43.140913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4445b-0bdf-4f46-893b-62484f0c7ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.141653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4445b-0bdf-4f46-893b-62484f0c7ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.142010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:43.142294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4445b-0bdf-4f46-893b-62484f0c7ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.214641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4445b-0bdf-4f46-893b-62484f0c7ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:43.216242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4445b-0bdf-4f46-893b-62484f0c7ce6 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:43.229476 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 923/1859] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:38:43.509580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8d6323a6bd4739a1c866f2e164934f', 'request_id': 'req-95bfbcee-9488-4344-bbc2-bd00d6ada844'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:43.633678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8d6323a6bd4739a1c866f2e164934f', 'request_id': 'req-95bfbcee-9488-4344-bbc2-bd00d6ada844'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:43.640729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8d6323a6bd4739a1c866f2e164934f', 'request_id': 'req-95bfbcee-9488-4344-bbc2-bd00d6ada844'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:43.651589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] The token cache is being invalidate because project 9f8d6323a6bd4739a1c866f2e164934f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:43.651876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:43.652536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:43.654078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 937/1860] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:42 2022] DELETE /identity/v3/projects/9f8d6323a6bd4739a1c866f2e164934f => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:43.659898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47aff-faa8-4aae-8ca9-90c9c1c3b434 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.660187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47aff-faa8-4aae-8ca9-90c9c1c3b434 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.660462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47aff-faa8-4aae-8ca9-90c9c1c3b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.679723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-eaf47aff-faa8-4aae-8ca9-90c9c1c3b434 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:43.680829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-eaf47aff-faa8-4aae-8ca9-90c9c1c3b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:43.687554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:43.687980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:43.781942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfbcee-9488-4344-bbc2-bd00d6ada844 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:43.806331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 924/1861] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:43.807048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:43.807048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.807483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.807483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] PATH_INFO: `/v3/projects/489aff28f60845f3a32e36013fec79cb` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.808592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489aff28f60845f3a32e36013fec79cb)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:43.811870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:43.813308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.813675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.814076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.853049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:43.856442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:43.871422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 925/1862] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:43.876700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:43.887644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893bd0-216b-4645-88f8-9e9c0c05b24e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:43.898908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:43.899917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.900658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.901132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.902149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:43.902719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:43.904756 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:43.920152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 926/1863] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:38:43.922941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:43.942121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8a090-56ea-4532-b47f-4140c4ce86ac admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:43.947796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:43.948668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:43.949153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:43.949432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:43.950174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:43.952464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.030098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489aff28f60845f3a32e36013fec79cb', 'request_id': 'req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:44.135668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489aff28f60845f3a32e36013fec79cb', 'request_id': 'req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:44.144236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489aff28f60845f3a32e36013fec79cb', 'request_id': 'req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:44.146667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 927/1864] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:43 2022] POST /identity/v3/projects => generated 357 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:44.151265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.157201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] The token cache is being invalidate because project 489aff28f60845f3a32e36013fec79cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:44.157508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:44.158153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f91a2300-8a4e-4a5b-aa2f-67dee76a3165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:44.160075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 938/1865] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:43 2022] DELETE /identity/v3/projects/489aff28f60845f3a32e36013fec79cb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:44.168614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4632b9b-cd73-464d-9362-0461b0d284ff None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.169262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4632b9b-cd73-464d-9362-0461b0d284ff None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.169761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4632b9b-cd73-464d-9362-0461b0d284ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.190232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b4632b9b-cd73-464d-9362-0461b0d284ff None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:44.191543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b4632b9b-cd73-464d-9362-0461b0d284ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:44.238071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c23b1-bf7b-4d03-8ca5-94fd0ebd0a85 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.246166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.246877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.247166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.247444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.248454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.250849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.276613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 939/1866] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:44.285336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.285627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.285909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.307199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:44.308424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:44.317816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 940/1867] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:44.322630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.331981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18b0b4-907c-42b7-a42a-6fb1ac1d2094 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.339098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.339441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.339888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.340172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.340938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:44.341248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.342913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.356266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 941/1868] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:38:44.374368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.383362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af63534-8f87-4252-b8e3-4656430f3937 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.389394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.390088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.390602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.390897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.391649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.394206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.540523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 928/1869] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:44 2022] POST /identity/v3/users => generated 279 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:44.542882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.544154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:44.558360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144ecd-fb44-41ec-9e1e-2b776e8a0e8b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.563201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.563891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.564170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.568939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.568939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.568939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.580618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 929/1870] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:44.584085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.586491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 942/1871] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:44 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:44.591339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.595068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ab09-6888-4772-b3d0-bb540585cb39 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.664995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01ca8a-5ee7-411f-8b03-e714742cfcfc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.665298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.666092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.666450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.666807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.667735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.669524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.670943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.671689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.671981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.672287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.672976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.675078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.682376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 930/1872] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:44.688018 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.699415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f40d4c-a956-427d-bc90-9f2807f158f0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.704481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3aced-5fb0-44aa-8da2-85fc64cfa675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.705385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3aced-5fb0-44aa-8da2-85fc64cfa675 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.705663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3aced-5fb0-44aa-8da2-85fc64cfa675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.705938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3aced-5fb0-44aa-8da2-85fc64cfa675 admin admin] PATH_INFO: `/v3/projects/d0a190826a764372ae7f45ae7511ab41/users/5e84c414924f440782549a33165bf739/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.736935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3aced-5fb0-44aa-8da2-85fc64cfa675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a190826a764372ae7f45ae7511ab41, user_id=5e84c414924f440782549a33165bf739, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.736935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3aced-5fb0-44aa-8da2-85fc64cfa675 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:44.874001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 943/1873] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:44 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:44.878308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:44.879686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 931/1874] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:44 2022] PUT /identity/v3/projects/d0a190826a764372ae7f45ae7511ab41/users/5e84c414924f440782549a33165bf739/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:44.890333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.890668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.890906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.891060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87020c-0f03-4668-a9b6-f6fa39e1b2ab admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:44.927861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] MFA Rules not processed for user `5e84c414924f440782549a33165bf739`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:44.929041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:44.992533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:44.993521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:44.994966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:44.995248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:44.996071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:44.998842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.015001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 944/1875] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:45.017675 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.041016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598ca1-3f03-4ed5-b683-95ef89eaa201 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.054336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.055150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.055491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.057774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.058093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.060864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.088520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 932/1876] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:38:45.089704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.096995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 945/1877] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:45.098327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.104990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654372e-f1fc-41ea-8c52-64a4c54fdce2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.113862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.114603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.114936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.115193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050b13-c024-4631-87b9-bd9929701775 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.115923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.116768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.120506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.121017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43574-80d0-41aa-8019-2892c36ea439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.122273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43574-80d0-41aa-8019-2892c36ea439 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.122644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43574-80d0-41aa-8019-2892c36ea439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.122992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43574-80d0-41aa-8019-2892c36ea439 admin admin] PATH_INFO: `/v3/projects/52b8ea3dbe2f43718a27e55eb18ab15d/users/feb0e47da68349eb9a3af2de8ee6aac7/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.146332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43574-80d0-41aa-8019-2892c36ea439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b8ea3dbe2f43718a27e55eb18ab15d, user_id=feb0e47da68349eb9a3af2de8ee6aac7, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.151079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43574-80d0-41aa-8019-2892c36ea439 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.271547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 946/1878] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:45 2022] PUT /identity/v3/projects/52b8ea3dbe2f43718a27e55eb18ab15d/users/feb0e47da68349eb9a3af2de8ee6aac7/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:45.282534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 933/1879] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:45 2022] POST /identity/v3/projects => generated 357 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:45.287050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.287642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.288434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.295154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.363762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] MFA Rules not processed for user `feb0e47da68349eb9a3af2de8ee6aac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:45.366808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:45.411932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcb8cb-9a05-44ee-b08e-53705b9f33bb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.423540 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.424675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.424965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.425242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.426088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.428316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.488266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 947/1880] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:45.497651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.500899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:45.596046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7038d8e-fc67-4901-ac4c-a31cff18ae4e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.600019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.600793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.601101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.601410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.611436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.612935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.629919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 948/1881] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:45.662532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 934/1882] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:45 2022] POST /identity/v3/users => generated 285 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:45.666045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.684227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6908-284a-4dcf-895d-314891026abb service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.689742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.690464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.690748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.691024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.691843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.693483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.706041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 949/1883] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:45.711255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.727666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126684a-1902-4489-bdc6-b39c3ca28b70 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.734847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.736119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.736442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.736714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] PATH_INFO: `/v3/projects/69c39823356b4e4da15d78f08658fd0f/users/45bd120e8c3d4cecb7b0c3ef1eec9084/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.770441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c39823356b4e4da15d78f08658fd0f, user_id=45bd120e8c3d4cecb7b0c3ef1eec9084, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.776052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.865579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 935/1884] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:45 2022] PUT /identity/v3/projects/69c39823356b4e4da15d78f08658fd0f/users/45bd120e8c3d4cecb7b0c3ef1eec9084/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:45.871207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.883211 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d858046-d7cd-48a0-affb-64f8cd443006 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.958056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1688d-b656-4c9f-b5dc-66e36efefa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:45.958765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1688d-b656-4c9f-b5dc-66e36efefa79 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:45.959051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1688d-b656-4c9f-b5dc-66e36efefa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:45.959327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1688d-b656-4c9f-b5dc-66e36efefa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:45.960080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1688d-b656-4c9f-b5dc-66e36efefa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:45.962127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1688d-b656-4c9f-b5dc-66e36efefa79 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:45.972777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 950/1885] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:45.980159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:45.994910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c07ac-532c-4b8c-8b8e-03a0278b45af admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:45.999964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:46.000896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:46.001143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:46.001413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] PATH_INFO: `/v3/projects/69c39823356b4e4da15d78f08658fd0f/users/45bd120e8c3d4cecb7b0c3ef1eec9084/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:46.003665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c39823356b4e4da15d78f08658fd0f, user_id=45bd120e8c3d4cecb7b0c3ef1eec9084, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:46.006478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:46.019912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 936/1886] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:45 2022] PUT /identity/v3/projects/69c39823356b4e4da15d78f08658fd0f/users/45bd120e8c3d4cecb7b0c3ef1eec9084/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:46.030565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:46.030853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:46.031134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:46.067476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] MFA Rules not processed for user `45bd120e8c3d4cecb7b0c3ef1eec9084`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:46.068748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:46.161640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 951/1887] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:46 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:46.172984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:46.177781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:46.233675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ab1d6-e658-4386-af80-bd74335a33c2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:46.237414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:46.238054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:46.242329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:46.242329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:46.248170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:46.249641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:46.259378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 937/1888] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:46.749415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:46.760739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912de76-fbc2-4dec-baf0-a061148e5e27 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:46.764715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228dd87-79a1-4f33-8b09-5b2aa3e35bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:46.765378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228dd87-79a1-4f33-8b09-5b2aa3e35bed service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:46.765663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228dd87-79a1-4f33-8b09-5b2aa3e35bed service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:46.765939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228dd87-79a1-4f33-8b09-5b2aa3e35bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:46.843826 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228dd87-79a1-4f33-8b09-5b2aa3e35bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:46.845330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228dd87-79a1-4f33-8b09-5b2aa3e35bed service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:46.855383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 952/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:46.860119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:46.861603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:46.932863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6f2cc-329a-4730-8f93-d52bf25baf88 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:46.937775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:46.938686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:46.938971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:46.939245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] PATH_INFO: `/v3/users/e13bb44cdd144ca3bc845d65b94d76b4` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:46.940491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13bb44cdd144ca3bc845d65b94d76b4)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:46.942519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:47.216796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13bb44cdd144ca3bc845d65b94d76b4'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:47.230012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13bb44cdd144ca3bc845d65b94d76b4'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:47.230914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13bb44cdd144ca3bc845d65b94d76b4'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:47.243342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13bb44cdd144ca3bc845d65b94d76b4'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:47.392831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13bb44cdd144ca3bc845d65b94d76b4'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:47.399385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 938/1890] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:46 2022] DELETE /identity/v3/users/e13bb44cdd144ca3bc845d65b94d76b4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:47.404158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:47.404768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:47.404768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:47.423478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:47.424731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:47.485021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 953/1891] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:47.495858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:47.502347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:47.591667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cea73-2a00-4261-99ac-bb4fca44c0d1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:47.613951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ee486-dbcc-4b28-904a-7f783868fa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:47.615888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee486-dbcc-4b28-904a-7f783868fa66 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:47.617514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee486-dbcc-4b28-904a-7f783868fa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:47.617968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ee486-dbcc-4b28-904a-7f783868fa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:47.642915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee486-dbcc-4b28-904a-7f783868fa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:47.644506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ee486-dbcc-4b28-904a-7f783868fa66 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:47.668790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 939/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:48.676245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:48.679820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:48.729218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fc9b4-8bc3-4d76-b571-b08bdb40ba4a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:48.737054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:48.739509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:48.740255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:48.740523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] PATH_INFO: `/v3/projects/d463bd1303c5402e852f801706e13a08` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:48.742312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d463bd1303c5402e852f801706e13a08)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:48.744770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:48.945791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd463bd1303c5402e852f801706e13a08', 'request_id': 'req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:49.067508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd463bd1303c5402e852f801706e13a08', 'request_id': 'req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:49.079490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd463bd1303c5402e852f801706e13a08', 'request_id': 'req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:49.093543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] The token cache is being invalidate because project d463bd1303c5402e852f801706e13a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:49.093870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:49.094670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bc8fa4f8-d38a-49c0-8d8c-d4e1bb3269b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:49.104257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 954/1893] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:48 2022] DELETE /identity/v3/projects/d463bd1303c5402e852f801706e13a08 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:49.110794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.111616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.111616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.134171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:49.135394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:49.243118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.243622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.244110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.244230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 940/1894] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:49.291715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:49.293063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:49.310088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 955/1895] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:49.311860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:49.325982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f294fe-9a1e-475b-b9bb-90fb7aa145c3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:49.333423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:49.334413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.336141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.336642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.337859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:49.338358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:49.340584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:49.354995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 941/1896] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:38:49.360016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:49.372143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075ffdd-ee92-4275-b8ba-27099744f048 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:49.378129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:49.379019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.379308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.379588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.380323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:49.383030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:49.556051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 956/1897] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:49 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:49.560609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:49.572900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526b3f9-6e61-4439-9020-54c3ae755f07 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:49.634164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:49.634784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.635077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.635378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.636087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:49.638027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:49.749244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 942/1898] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:49 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:49.753651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:49.764706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272e3c7-81e4-4f6c-b871-a94aa34cf965 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:49.769797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:49.770487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.770775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.771048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.771795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:49.773450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:49.785555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 957/1899] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:49.791032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:49.801162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a3f8e-88b0-45ad-8e21-ddb79fd7af83 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:49.806573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c4271-6ae8-46e1-9c15-ef918e01e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:49.807300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4271-6ae8-46e1-9c15-ef918e01e23e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.807585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4271-6ae8-46e1-9c15-ef918e01e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.807863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c4271-6ae8-46e1-9c15-ef918e01e23e admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.808608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4271-6ae8-46e1-9c15-ef918e01e23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:49.810256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c4271-6ae8-46e1-9c15-ef918e01e23e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:49.821087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 943/1900] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:49.826739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:49.837622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9756-99ee-4800-84d5-b87b02cd06b5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:49.843234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:49.844128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:49.844423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:49.844701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] PATH_INFO: `/v3/projects/70208b8743ea4feb923d6e2beb688601/users/f15ff80a12d647919ca9072f515bc1fd/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:49.861632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70208b8743ea4feb923d6e2beb688601, user_id=f15ff80a12d647919ca9072f515bc1fd, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:49.864404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:50.051783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 958/1901] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:49 2022] PUT /identity/v3/projects/70208b8743ea4feb923d6e2beb688601/users/f15ff80a12d647919ca9072f515bc1fd/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:50.062891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:50.063361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:50.063769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:50.097486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] MFA Rules not processed for user `f15ff80a12d647919ca9072f515bc1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:50.098727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:50.179551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 944/1902] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:50.191366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:50.193688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:50.265722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b35f0-54bd-42c6-932c-435b268370d7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:50.269753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf71dbf-a86d-4ec1-b051-72f90ecf521c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:50.270608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf71dbf-a86d-4ec1-b051-72f90ecf521c service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:50.270898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf71dbf-a86d-4ec1-b051-72f90ecf521c service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:50.271172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf71dbf-a86d-4ec1-b051-72f90ecf521c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:50.284675 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf71dbf-a86d-4ec1-b051-72f90ecf521c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:50.286407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf71dbf-a86d-4ec1-b051-72f90ecf521c service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:50.301277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 959/1903] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:50.346080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:50.433948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4da407-ddd4-48d1-88dc-16c6b2cad1aa None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:50.439006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:50.439864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:50.440149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:50.440431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] PATH_INFO: `/v3/users/f15ff80a12d647919ca9072f515bc1fd` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:50.441678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15ff80a12d647919ca9072f515bc1fd)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:50.443631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:50.751832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15ff80a12d647919ca9072f515bc1fd'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:50.769699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15ff80a12d647919ca9072f515bc1fd'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:50.770803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15ff80a12d647919ca9072f515bc1fd'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:50.783506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15ff80a12d647919ca9072f515bc1fd'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:50.907114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15ff80a12d647919ca9072f515bc1fd'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:50.914061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 945/1904] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:50 2022] DELETE /identity/v3/users/f15ff80a12d647919ca9072f515bc1fd => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:50.918667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:50.919175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:50.919314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:50.939840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:50.941047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:51.000231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 960/1905] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:51.016419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:51.017958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:51.095702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dceef1-8898-4f2d-bca9-0ac48e158f23 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:51.099374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3e000-7e81-41fa-8739-4acd7f02d050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:51.100029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e000-7e81-41fa-8739-4acd7f02d050 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:51.100314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e000-7e81-41fa-8739-4acd7f02d050 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:51.101834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e000-7e81-41fa-8739-4acd7f02d050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:51.117240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3e000-7e81-41fa-8739-4acd7f02d050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:51.118895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3e000-7e81-41fa-8739-4acd7f02d050 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:51.130411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 946/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:51.778326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:51.779802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:51.795355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22c78-85ce-4e29-b04a-09ec04b1f4e8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:51.803235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:51.804775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:51.805264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:51.805731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] PATH_INFO: `/v3/projects/70208b8743ea4feb923d6e2beb688601` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:51.807865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70208b8743ea4feb923d6e2beb688601)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:51.811554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:52.025259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70208b8743ea4feb923d6e2beb688601', 'request_id': 'req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:52.170161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70208b8743ea4feb923d6e2beb688601', 'request_id': 'req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:52.176972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70208b8743ea4feb923d6e2beb688601', 'request_id': 'req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:52.187837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] The token cache is being invalidate because project 70208b8743ea4feb923d6e2beb688601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:52.188122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:52.188779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9f8f33a-748f-4c21-9d9a-e3fbbc7164d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:52.190404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 961/1907] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:51 2022] DELETE /identity/v3/projects/70208b8743ea4feb923d6e2beb688601 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:52.196966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.197503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.197503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.215782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:52.216983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:52.286618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 947/1908] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:52.294332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.294622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.294902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.323982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:52.325615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:52.336880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 962/1909] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:52.340970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:52.352905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbe334-0f51-444d-83b7-5c81f4a5d304 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:52.359922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:52.360775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.361127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.361468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.362782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:38:52.363165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:52.365149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:52.380252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 948/1910] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:38:52.389961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:52.406136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73ffa-8da9-4a15-b0c4-7a47a4ef2319 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:52.414164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:52.414921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.417350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.418972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.419986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:52.421918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:52.660817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 963/1911] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:38:52 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:38:52.664783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:52.677220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f00c-120b-46ec-8466-9f8c93971ba2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:52.765004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:52.765742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.766020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.766331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.767046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:52.769003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:52.884121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 949/1912] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:38:52 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:38:52.887900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:52.900368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddd776-3e5a-438a-a9fc-38ab34482393 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:52.905314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:52.905807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.906083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.906409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.907155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:52.908778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:52.924463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 964/1913] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:38:52.925517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:52.937854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51f3c8-03a1-4ea8-b32e-a411a584f1ef admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:52.942983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f913a-b965-458b-9762-6d5cf7b97a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:52.943654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f913a-b965-458b-9762-6d5cf7b97a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.943938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f913a-b965-458b-9762-6d5cf7b97a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.944214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f913a-b965-458b-9762-6d5cf7b97a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.945639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f913a-b965-458b-9762-6d5cf7b97a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:52.947350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f913a-b965-458b-9762-6d5cf7b97a2d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:52.958328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 950/1914] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:38:52.963316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:52.973604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d6e61-9305-4c41-b0ea-0f4b8ef1c67d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:52.978836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:52.980131 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:52.980337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:52.980588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] PATH_INFO: `/v3/projects/51d2f537a79a40f793f17573c3c26ba7/users/fbbc21f8524046df82e09f3e5628213e/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:52.996702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d2f537a79a40f793f17573c3c26ba7, user_id=fbbc21f8524046df82e09f3e5628213e, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:52.999484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:53.172283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 965/1915] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:38:52 2022] PUT /identity/v3/projects/51d2f537a79a40f793f17573c3c26ba7/users/fbbc21f8524046df82e09f3e5628213e/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:38:53.183776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49ed3-3b34-46e1-b4cd-ca4b67276157 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:53.184199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49ed3-3b34-46e1-b4cd-ca4b67276157 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:53.184519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49ed3-3b34-46e1-b4cd-ca4b67276157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:53.211865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b4a49ed3-3b34-46e1-b4cd-ca4b67276157 None None] MFA Rules not processed for user `fbbc21f8524046df82e09f3e5628213e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:53.213070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b4a49ed3-3b34-46e1-b4cd-ca4b67276157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:53.280526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 951/1916] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:53.290102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:53.291946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:53.367046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fff5f-5875-4430-93e1-db84991c4049 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:53.370957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:53.371642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:53.371923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:53.372194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:53.381036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:53.382899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:53.392057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 966/1917] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:38:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:38:56.077058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:56.077768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:56.077768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:56.104443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] MFA Rules not processed for user `fbbc21f8524046df82e09f3e5628213e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:56.106105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:56.114577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 952/1918] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:38:58.291817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:58.293915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:58.374517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8ac6-e8f9-4701-b1c0-01c6b676bb22 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:58.379138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:58.380044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:58.380328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:58.380604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] PATH_INFO: `/v3/users/8fa7971d6f99464bbe62c60e318cf414` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:58.381825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa7971d6f99464bbe62c60e318cf414)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:58.384093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:58.745968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa7971d6f99464bbe62c60e318cf414'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:58.753428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa7971d6f99464bbe62c60e318cf414'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:58.754161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa7971d6f99464bbe62c60e318cf414'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:58.754813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa7971d6f99464bbe62c60e318cf414'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:58.769087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa7971d6f99464bbe62c60e318cf414'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:58.900082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 967/1919] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:58 2022] DELETE /identity/v3/users/8fa7971d6f99464bbe62c60e318cf414 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:59.254812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:59.256191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:59.297744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2e55-4f70-417a-84c4-7f913b25806d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:59.406381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:59.407584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:59.408030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:59.408465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] PATH_INFO: `/v3/users/feb0e47da68349eb9a3af2de8ee6aac7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:59.415288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb0e47da68349eb9a3af2de8ee6aac7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:59.415288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:59.453357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:38:59.455282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:38:59.474616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171acbb-822f-455d-9b10-600134641034 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:38:59.487212 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:38:59.489034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:59.489761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:59.490466 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] PATH_INFO: `/v3/projects/dd16126432b64642b65fa0a3d8bd7043` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:59.493372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd16126432b64642b65fa0a3d8bd7043)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:38:59.496092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:38:59.791050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb0e47da68349eb9a3af2de8ee6aac7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.792026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd16126432b64642b65fa0a3d8bd7043', 'request_id': 'req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.802604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb0e47da68349eb9a3af2de8ee6aac7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.803243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb0e47da68349eb9a3af2de8ee6aac7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.812869 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb0e47da68349eb9a3af2de8ee6aac7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.924582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd16126432b64642b65fa0a3d8bd7043', 'request_id': 'req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.931822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd16126432b64642b65fa0a3d8bd7043', 'request_id': 'req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.943579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] The token cache is being invalidate because project dd16126432b64642b65fa0a3d8bd7043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:38:59.943905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.947339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0633cd59-d4aa-4afa-b8d7-b53bfb521dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:38:59.947339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 968/1920] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:38:59 2022] DELETE /identity/v3/projects/dd16126432b64642b65fa0a3d8bd7043 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:38:59.952116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28541b05-e74d-416f-92f4-f379079a4ac2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:38:59.952461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28541b05-e74d-416f-92f4-f379079a4ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:38:59.952747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28541b05-e74d-416f-92f4-f379079a4ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:38:59.979074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-28541b05-e74d-416f-92f4-f379079a4ac2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:38:59.981173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-28541b05-e74d-416f-92f4-f379079a4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:00.045501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-76a0ac31-df07-4239-b06d-7745970dfbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb0e47da68349eb9a3af2de8ee6aac7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:00.066730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 953/1921] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:38:59 2022] DELETE /identity/v3/users/feb0e47da68349eb9a3af2de8ee6aac7 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:00.069114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.070299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.070729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 969/1922] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:00.071008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.079979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.080493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.081014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.125357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:00.127892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:00.132663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:00.135060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:00.230261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 970/1923] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:00.247519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.249784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:00.256519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 954/1924] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:00.264521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.281517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc17f-2460-456a-802e-b1261e22ede1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.289557 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.290913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.291815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.292461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.293586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:00.294314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.296860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:00.313939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 955/1925] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:00.314826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.325519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb07c31-ec85-402b-96a1-c29602e2188a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.330629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.337738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.337738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.337738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.337738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.337738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:00.385585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a1e8-c2f3-4971-910f-ed2a45c89060 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.392327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.393470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.393991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.394511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.413090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.416820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:00.436169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 971/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:39:00.550469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 956/1927] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:00 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:00.555292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.565032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9087109-df5a-44bc-a741-81908a724f6d service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.624229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.625049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.625420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.625791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.626794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.629014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:00.824052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 972/1928] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:00 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:00.831560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.845935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5c2e3-68c2-4b2d-af90-bae2ab7b507e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.852287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.853175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.853464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.853810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.854727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.856531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:00.869189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 957/1929] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:00.873780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.884152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17518d-d9e1-4c5f-bb21-7074ed3d4067 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.889256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.889923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.890243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.890515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.891268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.892886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:00.903545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 973/1930] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:00.907846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:00.919565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f2cb-b07a-49e0-923f-a076c0fd21da admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:00.925033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fa1e0-fead-4c51-92c6-565fd8d4de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:00.926637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fa1e0-fead-4c51-92c6-565fd8d4de4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:00.926914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fa1e0-fead-4c51-92c6-565fd8d4de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:00.927188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fa1e0-fead-4c51-92c6-565fd8d4de4d admin admin] PATH_INFO: `/v3/projects/c807a38dcff14bf2b94e4989552e9a6b/users/0ca04a0190a547d0b9e76c1abb50975a/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:00.946735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fa1e0-fead-4c51-92c6-565fd8d4de4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c807a38dcff14bf2b94e4989552e9a6b, user_id=0ca04a0190a547d0b9e76c1abb50975a, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:00.950490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fa1e0-fead-4c51-92c6-565fd8d4de4d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:01.059309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:01.061017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:01.064649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 958/1931] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:00 2022] PUT /identity/v3/projects/c807a38dcff14bf2b94e4989552e9a6b/users/0ca04a0190a547d0b9e76c1abb50975a/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:01.075436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:01.075728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:01.076004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:01.082403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f41b6-02b7-4efa-b5a8-c6d6c779d1bb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:01.123511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] MFA Rules not processed for user `0ca04a0190a547d0b9e76c1abb50975a`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:01.125002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:01.182480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:01.183648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:01.183987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:01.184269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] PATH_INFO: `/v3/projects/52b8ea3dbe2f43718a27e55eb18ab15d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:01.193235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b8ea3dbe2f43718a27e55eb18ab15d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:01.199346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:01.243871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 959/1932] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:01.256793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:01.260818 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:01.369616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7cf8-3377-4c94-b493-aab6c9208106 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:01.377261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8a6e-35a4-4e33-9b7a-a843cd847b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:01.378205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8a6e-35a4-4e33-9b7a-a843cd847b94 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:01.378703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8a6e-35a4-4e33-9b7a-a843cd847b94 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:01.379174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8a6e-35a4-4e33-9b7a-a843cd847b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:01.394768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c8a6e-35a4-4e33-9b7a-a843cd847b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:01.403735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c8a6e-35a4-4e33-9b7a-a843cd847b94 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:01.421230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 960/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:01.437612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b8ea3dbe2f43718a27e55eb18ab15d', 'request_id': 'req-f6d1956a-925c-404a-b996-180e3274a93d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:01.650535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b8ea3dbe2f43718a27e55eb18ab15d', 'request_id': 'req-f6d1956a-925c-404a-b996-180e3274a93d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:01.662810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b8ea3dbe2f43718a27e55eb18ab15d', 'request_id': 'req-f6d1956a-925c-404a-b996-180e3274a93d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:01.679382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] The token cache is being invalidate because project 52b8ea3dbe2f43718a27e55eb18ab15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:01.680003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:01.681007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f6d1956a-925c-404a-b996-180e3274a93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:01.683763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 974/1934] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:01 2022] DELETE /identity/v3/projects/52b8ea3dbe2f43718a27e55eb18ab15d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:01.693070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:01.693620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:01.694097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:01.769376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:01.771754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:01.941839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:01.941839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:01.941839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:01.942094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 961/1935] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:01.971206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:01.972919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:01.991623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:01.993642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:01.999696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 975/1936] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:02.004199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.015259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ff1cc-163e-4424-af4b-d5e46f223010 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.018878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0bae-1071-44b5-9ba4-af298ed35e49 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.021046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.021930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.022238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.022527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.024313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:02.024632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.025157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.026258 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.026393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.026768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.027143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] PATH_INFO: `/v3/users/0ca04a0190a547d0b9e76c1abb50975a` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.028900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca04a0190a547d0b9e76c1abb50975a)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.031141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.043779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 976/1937] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:02.048376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.061125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c525c2c-2d5b-4db6-8a7f-cdc9a998608e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.066900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.067985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.068111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.068284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.068998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.071202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.286253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 977/1938] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:02 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:02.290474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.325338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca04a0190a547d0b9e76c1abb50975a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:02.341979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca04a0190a547d0b9e76c1abb50975a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:02.343145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca04a0190a547d0b9e76c1abb50975a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:02.350569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca04a0190a547d0b9e76c1abb50975a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:02.390203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f622-8e53-4e0e-b9f2-f99f28004107 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.395280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7005f5-21fe-4f80-ab66-a2bb584b7553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.395971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005f5-21fe-4f80-ab66-a2bb584b7553 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.396743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005f5-21fe-4f80-ab66-a2bb584b7553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.396743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005f5-21fe-4f80-ab66-a2bb584b7553 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.397225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7005f5-21fe-4f80-ab66-a2bb584b7553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.400182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7005f5-21fe-4f80-ab66-a2bb584b7553 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.467862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12b0a1a2-66f8-4361-b381-c8fecdc7fd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca04a0190a547d0b9e76c1abb50975a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:02.474727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 962/1939] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:01 2022] DELETE /identity/v3/users/0ca04a0190a547d0b9e76c1abb50975a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:02.476414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.476605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.476936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.496384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] MFA Rules not processed for user `b6431c85b6c74608aae42e0e856d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:02.497985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:02.548836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 978/1940] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:02 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:02.555308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.555714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.556115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.578003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:02.578003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:02.582445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 963/1941] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:02.590491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.592994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:02.674242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 979/1942] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:02.683840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.685712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:02.706889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a301c9-be33-436c-b1d7-2f6446cc122c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.716875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.717987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.718449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.718924 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.721079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.723567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.744452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 964/1943] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:02.766127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.822279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb650e8-931d-4ad7-8878-9569240bbb54 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.840193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.840193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.842170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.842170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.845850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.852911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.865097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b96af-1998-4d73-a2c1-e81e7abe7c54 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.890245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b9c28-ba91-4099-8691-2e881464c1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.890912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b9c28-ba91-4099-8691-2e881464c1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.891194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b9c28-ba91-4099-8691-2e881464c1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.891474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b9c28-ba91-4099-8691-2e881464c1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.893730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 965/1944] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:02.900002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:02.918436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b9c28-ba91-4099-8691-2e881464c1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.926537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b9c28-ba91-4099-8691-2e881464c1b5 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:02.926773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e18023-3975-48a7-82d6-0b5db775e17e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:02.938758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:02.942244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:02.943868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:02.946437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] PATH_INFO: `/v3/projects/9b6657fcd6804c71b17de58e07593bc7/users/e4280100e6d74fe89fbc1b00eafea1fd/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:02.973224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 980/1945] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:39:02.992215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6657fcd6804c71b17de58e07593bc7, user_id=e4280100e6d74fe89fbc1b00eafea1fd, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:02.995842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:03.169838 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 966/1946] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:02 2022] PUT /identity/v3/projects/9b6657fcd6804c71b17de58e07593bc7/users/e4280100e6d74fe89fbc1b00eafea1fd/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:03.190718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:03.191589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:03.191739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:03.257399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] MFA Rules not processed for user `e4280100e6d74fe89fbc1b00eafea1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:03.259167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:03.362275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 981/1947] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:03.366185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:03.474896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e595a0-f8e7-49f5-bea5-cfb4d452fef5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:03.491250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:03.493589 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:03.494378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:03.494863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:03.495779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:03.498137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:03.682964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 967/1948] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:03 2022] POST /identity/v3/projects => generated 373 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:03.685083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:03.713754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c6ff3-4297-47b2-8e19-50f05fe5876c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:03.830996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:03.832666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:03.833156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:03.833605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:03.835035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:03.839754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:04.021052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:04.025113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:04.025616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 982/1949] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:03 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:04.029995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:04.082778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c41a5-6715-4997-a3b3-f80a248b81a4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:04.086300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788794a6-45ea-49ea-a89c-1d67c64e15dc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:04.106235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:04.108129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.108728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.109755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] PATH_INFO: `/v3/projects/c807a38dcff14bf2b94e4989552e9a6b` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.114099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:04.114396 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c807a38dcff14bf2b94e4989552e9a6b)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:04.115813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.116264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.117316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.118947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:04.126772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:04.129902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:04.170961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 983/1950] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:04.172777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:04.201429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11558235-a0e2-40c4-bdb4-c20328c0612f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:04.230016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:04.234396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.234877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.235352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] PATH_INFO: `/v3/projects/df58044081194226ae94d69669c9075b/users/61cef088606749a299bb47da61791a2c/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.284758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df58044081194226ae94d69669c9075b, user_id=61cef088606749a299bb47da61791a2c, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:04.308315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:04.464481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 984/1951] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:04 2022] PUT /identity/v3/projects/df58044081194226ae94d69669c9075b/users/61cef088606749a299bb47da61791a2c/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:04.468967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:04.479864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c807a38dcff14bf2b94e4989552e9a6b', 'request_id': 'req-9fdb5768-b09c-42ae-993a-dc15fd92da41'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:04.566443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5399-6f3c-4f14-a9ab-94249f563ff5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:04.673929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:04.675018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.676407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.676903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.678827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:04.682323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:04.704720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 985/1952] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:04.711815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:04.718558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c807a38dcff14bf2b94e4989552e9a6b', 'request_id': 'req-9fdb5768-b09c-42ae-993a-dc15fd92da41'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:04.720108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c807a38dcff14bf2b94e4989552e9a6b', 'request_id': 'req-9fdb5768-b09c-42ae-993a-dc15fd92da41'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:04.730850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb201-f1ac-4361-aff3-4b1af14e7a2e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:04.736262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] The token cache is being invalidate because project c807a38dcff14bf2b94e4989552e9a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:04.736262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:04.736882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9fdb5768-b09c-42ae-993a-dc15fd92da41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:04.745530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 968/1953] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:04 2022] DELETE /identity/v3/projects/c807a38dcff14bf2b94e4989552e9a6b => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:04.746969 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fdd21-51fa-4b76-b273-85c8f58d5193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:04.748078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdd21-51fa-4b76-b273-85c8f58d5193 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.748353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdd21-51fa-4b76-b273-85c8f58d5193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.748701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fdd21-51fa-4b76-b273-85c8f58d5193 admin admin] PATH_INFO: `/v3/projects/df58044081194226ae94d69669c9075b/users/61cef088606749a299bb47da61791a2c/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.752700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fdd21-51fa-4b76-b273-85c8f58d5193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df58044081194226ae94d69669c9075b, user_id=61cef088606749a299bb47da61791a2c, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:04.753258 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be6154-5a26-48be-ba5d-11f58e020365 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.753719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be6154-5a26-48be-ba5d-11f58e020365 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.754164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be6154-5a26-48be-ba5d-11f58e020365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.762104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fdd21-51fa-4b76-b273-85c8f58d5193 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:04.795427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 986/1954] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:04 2022] PUT /identity/v3/projects/df58044081194226ae94d69669c9075b/users/61cef088606749a299bb47da61791a2c/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:04.814573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:04.815080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:04.815567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:04.869696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-12be6154-5a26-48be-ba5d-11f58e020365 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:04.875250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-12be6154-5a26-48be-ba5d-11f58e020365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:04.920588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] MFA Rules not processed for user `61cef088606749a299bb47da61791a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:04.927111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:05.080796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 969/1955] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:05.102158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.102565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.102855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.137280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:05.139215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:05.154306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 970/1956] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:05.158700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.197270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4a970-a917-4a74-a904-a6636bf041c1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.223008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.223702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.223985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.224261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.230003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 987/1957] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:05.231176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:05.233062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.234837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:05.246590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.252021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:05.277375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 971/1958] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:39:05.277375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.296671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1d3e-9920-4992-aacf-55174508feda admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.300225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.301061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.301408 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.301688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.302754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.306145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:05.363462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b99b9d-146d-4acc-a8ca-63b3cec545b9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.369412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.370138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.370671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.371168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.375175 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:05.455292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.456800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:05.470405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 988/1959] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:05.505645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 972/1960] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:05 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:05.512390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.527228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1218-7069-4b1f-960f-218cf1605a64 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.635176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.638815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.639042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.639577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.641142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.645920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:05.853607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 989/1961] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:05 2022] POST /identity/v3/users => generated 303 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:05.858326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.869117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45201e0-dd06-4ae7-9bf6-45e1c7ce8a5d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.873759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.874533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.874817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.875086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.875827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.877424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:05.892943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 973/1962] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:05.896941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.907268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97534c-ea96-4c14-8dbd-40f8a54ee96d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.912113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb593-c46c-47d8-97ad-d237fbca7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.912778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb593-c46c-47d8-97ad-d237fbca7a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.913060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb593-c46c-47d8-97ad-d237fbca7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.913339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb593-c46c-47d8-97ad-d237fbca7a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.914125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bb593-c46c-47d8-97ad-d237fbca7a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.916019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bb593-c46c-47d8-97ad-d237fbca7a65 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:05.926545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 990/1963] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:05.931310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:05.943189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72b01-6ff8-4130-9a9d-c8d4bae186d3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:05.950235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:05.951488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:05.951876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:05.952230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] PATH_INFO: `/v3/projects/3397332e92754408b7d79eb4f7fb4a76/users/d5e641f09bee45d08fdb2762861d93b0/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:05.972663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3397332e92754408b7d79eb4f7fb4a76, user_id=d5e641f09bee45d08fdb2762861d93b0, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:05.977000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:06.091971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 974/1964] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:05 2022] PUT /identity/v3/projects/3397332e92754408b7d79eb4f7fb4a76/users/d5e641f09bee45d08fdb2762861d93b0/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:06.105475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:06.105769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:06.106068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:06.141879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] MFA Rules not processed for user `d5e641f09bee45d08fdb2762861d93b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:06.143145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:06.233974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 991/1965] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:06.238958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:06.345084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233018ed-93ec-42b6-baa3-e25c12471e36 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:06.353864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:06.355060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:06.355615 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:06.356177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:06.357893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:06.362039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:06.558019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 975/1966] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:06 2022] POST /identity/v3/projects => generated 405 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:06.562904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:06.580757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab02224-c9bc-46e5-9fc2-27e45504c1de None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:06.683829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:06.684562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:06.684888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:06.685169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:06.686088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:06.688294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:06.793790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 992/1967] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:06 2022] POST /identity/v3/users => generated 309 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:06.800206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:06.825542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b534ae-7d43-4767-83bb-1a2e71439a95 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:06.839689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:06.840343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:06.841705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:06.841991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:06.842794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:06.844529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:06.864760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 976/1968] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:06.870292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:06.887538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46841c-02e2-4019-a3c6-6bd739e494d2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:06.895511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:06.906339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:06.907177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:06.907537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] PATH_INFO: `/v3/projects/1b21b8c94c0c45cc8d25193c286885e3/users/3738ce0eb1294c3497c601812dc44814/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:06.931573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b21b8c94c0c45cc8d25193c286885e3, user_id=3738ce0eb1294c3497c601812dc44814, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:06.934349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:07.108049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 993/1969] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:06 2022] PUT /identity/v3/projects/1b21b8c94c0c45cc8d25193c286885e3/users/3738ce0eb1294c3497c601812dc44814/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:07.115873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:07.129388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845a78d-2c7c-432b-87c1-fb23cdb110c8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:07.208048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87c19a-38c1-40bd-b604-57c3d33d1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:07.209788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87c19a-38c1-40bd-b604-57c3d33d1404 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:07.210105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87c19a-38c1-40bd-b604-57c3d33d1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:07.212849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87c19a-38c1-40bd-b604-57c3d33d1404 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:07.213305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87c19a-38c1-40bd-b604-57c3d33d1404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:07.215150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87c19a-38c1-40bd-b604-57c3d33d1404 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:07.237777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 977/1970] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:07.243517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:07.257022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488385d-2ca0-4f30-9a11-7554b32974d7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:07.263843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:07.264982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:07.265329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:07.265610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] PATH_INFO: `/v3/projects/1b21b8c94c0c45cc8d25193c286885e3/users/3738ce0eb1294c3497c601812dc44814/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:07.268439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b21b8c94c0c45cc8d25193c286885e3, user_id=3738ce0eb1294c3497c601812dc44814, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:07.271498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:07.291338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 994/1971] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:07 2022] PUT /identity/v3/projects/1b21b8c94c0c45cc8d25193c286885e3/users/3738ce0eb1294c3497c601812dc44814/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:07.303922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:07.304922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:07.305339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:07.350012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] MFA Rules not processed for user `3738ce0eb1294c3497c601812dc44814`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:07.352002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:07.509122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 978/1972] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:07 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:07.518669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:07.520452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:07.637055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38c597-303f-475a-a5b7-6fc41b9fb748 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:07.642012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a63ce-5ec3-48a8-ac82-01afa094f30c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:07.642985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a63ce-5ec3-48a8-ac82-01afa094f30c service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:07.643489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a63ce-5ec3-48a8-ac82-01afa094f30c service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:07.644360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a63ce-5ec3-48a8-ac82-01afa094f30c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:07.655851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a63ce-5ec3-48a8-ac82-01afa094f30c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:07.657304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a63ce-5ec3-48a8-ac82-01afa094f30c service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:07.670588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 995/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:07 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:08.013068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:08.105825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abfe1a-025a-4097-901c-f0e83b632074 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:08.112171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:08.113272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:08.113520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:08.113760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] PATH_INFO: `/v3/users/d5e641f09bee45d08fdb2762861d93b0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:08.115689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e641f09bee45d08fdb2762861d93b0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:08.118019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:08.439471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e641f09bee45d08fdb2762861d93b0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:08.454890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e641f09bee45d08fdb2762861d93b0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:08.457971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e641f09bee45d08fdb2762861d93b0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:08.467858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e641f09bee45d08fdb2762861d93b0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:08.548183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e641f09bee45d08fdb2762861d93b0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:08.555918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 979/1974] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:08 2022] DELETE /identity/v3/users/d5e641f09bee45d08fdb2762861d93b0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:08.562272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:08.563225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:08.563545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:08.588431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:08.588431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:08.656793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 996/1975] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:08.675152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:08.677706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:08.850007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c2c11-3c99-4a94-96f3-557361678484 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:08.855931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:08.856941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:08.857793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:08.858288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:08.871610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:08.874331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:08.889458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 980/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:09.198596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:09.206140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:09.231145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c5d12-b98d-493f-82cd-4452aa2e24ec None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:09.243588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:09.245679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:09.246387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:09.247195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] PATH_INFO: `/v3/users/e4280100e6d74fe89fbc1b00eafea1fd` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:09.249616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4280100e6d74fe89fbc1b00eafea1fd)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:09.254237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:09.644813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:09.647096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:09.675266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee095-6f9d-4d1d-9927-3472f9b32732 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:09.699795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:09.700418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:09.700703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:09.700968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] PATH_INFO: `/v3/projects/3397332e92754408b7d79eb4f7fb4a76` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:09.706858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3397332e92754408b7d79eb4f7fb4a76)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:09.708821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:09.734845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4280100e6d74fe89fbc1b00eafea1fd'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.744395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4280100e6d74fe89fbc1b00eafea1fd'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.745158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4280100e6d74fe89fbc1b00eafea1fd'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.745774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4280100e6d74fe89fbc1b00eafea1fd'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.764379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e827be33-940f-4029-b052-fe50d0f20f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4280100e6d74fe89fbc1b00eafea1fd'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.857265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3397332e92754408b7d79eb4f7fb4a76', 'request_id': 'req-c4198b74-49d3-4d32-960b-d5d0f474ecb6'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.871489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 997/1977] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:09 2022] DELETE /identity/v3/users/e4280100e6d74fe89fbc1b00eafea1fd => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:09.879032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:09.879743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:09.880324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:09.903000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:09.905564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:09.959677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3397332e92754408b7d79eb4f7fb4a76', 'request_id': 'req-c4198b74-49d3-4d32-960b-d5d0f474ecb6'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.968334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3397332e92754408b7d79eb4f7fb4a76', 'request_id': 'req-c4198b74-49d3-4d32-960b-d5d0f474ecb6'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.990020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] The token cache is being invalidate because project 3397332e92754408b7d79eb4f7fb4a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:09.990421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.992135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 998/1978] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:09.992495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:09.994252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 981/1979] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:09 2022] DELETE /identity/v3/projects/3397332e92754408b7d79eb4f7fb4a76 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:09.998892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:10.000870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:10.019103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ea3c7-93cf-4f8f-89b5-3bb22955e1a3 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:10.020996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:10.022464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:10.026655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:10.027810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:10.028375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:10.028946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] PATH_INFO: `/v3/users/3738ce0eb1294c3497c601812dc44814` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:10.031233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3738ce0eb1294c3497c601812dc44814)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:10.033317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:10.153211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198b74-49d3-4d32-960b-d5d0f474ecb6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:10.266933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:10.267626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:10.267907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:10.268185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:10.270297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:10.285976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:10.287671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:10.301857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 982/1980] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:10.420077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3738ce0eb1294c3497c601812dc44814'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:10.431143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3738ce0eb1294c3497c601812dc44814'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:10.432505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3738ce0eb1294c3497c601812dc44814'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:10.433127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3738ce0eb1294c3497c601812dc44814'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:10.451591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3738ce0eb1294c3497c601812dc44814'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:10.631569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 999/1981] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:09 2022] DELETE /identity/v3/users/3738ce0eb1294c3497c601812dc44814 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:11.175298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:11.177219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:11.189587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85139da1-1fa3-4e82-ac1c-21c858fcb692 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:11.267507 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:11.268844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:11.269292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:11.269755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] PATH_INFO: `/v3/projects/9b6657fcd6804c71b17de58e07593bc7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:11.271715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6657fcd6804c71b17de58e07593bc7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:11.275335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:11.440218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:11.441852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:11.467901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e614a5-68b9-4bc4-94c5-f0feedf9f7f2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:11.480048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6657fcd6804c71b17de58e07593bc7', 'request_id': 'req-cf467dad-be49-4122-8728-3252c36cf8a0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.600048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:11.601470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:11.601762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:11.602196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] PATH_INFO: `/v3/projects/1b21b8c94c0c45cc8d25193c286885e3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:11.603832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b21b8c94c0c45cc8d25193c286885e3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:11.605836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:11.617462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6657fcd6804c71b17de58e07593bc7', 'request_id': 'req-cf467dad-be49-4122-8728-3252c36cf8a0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.624713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6657fcd6804c71b17de58e07593bc7', 'request_id': 'req-cf467dad-be49-4122-8728-3252c36cf8a0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.637633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] The token cache is being invalidate because project 9b6657fcd6804c71b17de58e07593bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:11.637925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.638652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.643896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 983/1982] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:11 2022] DELETE /identity/v3/projects/9b6657fcd6804c71b17de58e07593bc7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:11.647438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:11.650986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:11.665313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf467dad-be49-4122-8728-3252c36cf8a0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:11.670957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:11.672051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:11.672332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:11.673372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] PATH_INFO: `/v3/users/61cef088606749a299bb47da61791a2c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:11.674884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cef088606749a299bb47da61791a2c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:11.676930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:11.788732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b21b8c94c0c45cc8d25193c286885e3', 'request_id': 'req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.919427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b21b8c94c0c45cc8d25193c286885e3', 'request_id': 'req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.926612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b21b8c94c0c45cc8d25193c286885e3', 'request_id': 'req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.938438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] The token cache is being invalidate because project 1b21b8c94c0c45cc8d25193c286885e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:11.938729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.939384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b9bd435f-05ce-4f8d-a6a6-7561eb2ce8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:11.941124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1000/1983] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:11 2022] DELETE /identity/v3/projects/1b21b8c94c0c45cc8d25193c286885e3 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:11.947517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5eab0-a290-46e0-8015-ab5fe07b40da None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:11.947805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5eab0-a290-46e0-8015-ab5fe07b40da None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:11.948141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5eab0-a290-46e0-8015-ab5fe07b40da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:11.968923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-79c5eab0-a290-46e0-8015-ab5fe07b40da None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:11.973107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-79c5eab0-a290-46e0-8015-ab5fe07b40da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:11.985542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cef088606749a299bb47da61791a2c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:12.011499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cef088606749a299bb47da61791a2c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:12.012890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cef088606749a299bb47da61791a2c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:12.023083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cef088606749a299bb47da61791a2c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:12.057571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1001/1984] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:12.065389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.065733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.065944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.087030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:12.088435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:12.096377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1002/1985] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:12.100706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.112525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46eaa-f258-48c7-86b4-fd108aabbef6 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.113621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cef088606749a299bb47da61791a2c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:12.118757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153b35-6798-477e-9020-199299964b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.119426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153b35-6798-477e-9020-199299964b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.121716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153b35-6798-477e-9020-199299964b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.121716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60153b35-6798-477e-9020-199299964b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.121716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153b35-6798-477e-9020-199299964b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:12.121716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153b35-6798-477e-9020-199299964b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.122977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60153b35-6798-477e-9020-199299964b35 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.125209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 984/1986] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:11 2022] DELETE /identity/v3/users/61cef088606749a299bb47da61791a2c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:12.138391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1003/1987] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:12.140082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.141655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:12.212082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2467-9567-4338-88f1-8fc4c318100f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.217258 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.217927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.218231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.218512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.219248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.221182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.367330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 985/1988] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:12 2022] POST /identity/v3/projects => generated 365 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:12.371354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153b35-6798-477e-9020-199299964b35 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.381773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60153b35-6798-477e-9020-199299964b35 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.443761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.444513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.444685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.445622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.446366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.448300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.555469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1004/1989] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:12 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:12.563618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.582788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0497-0640-4844-9586-8a0f44d19799 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.590917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.592054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.592561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.593058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.594484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.599471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.620433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 986/1990] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:12.624585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.637054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeccd92-9630-4ecb-abcc-9f3326675a13 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.642342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.643032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.643332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.643600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.644371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.646154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.657996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1005/1991] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:12.662475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.673296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f30a-e318-495a-9c53-1d61d922ca0b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.680439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be9d3-af40-4d06-ac48-11ccfcaa0c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.681326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be9d3-af40-4d06-ac48-11ccfcaa0c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.681605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be9d3-af40-4d06-ac48-11ccfcaa0c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.681875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be9d3-af40-4d06-ac48-11ccfcaa0c84 admin admin] PATH_INFO: `/v3/projects/92ed03e4f2a848aa95e7d494b20065c1/users/84c712377f084cedabfaa4d0a3aab0d2/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.702099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be9d3-af40-4d06-ac48-11ccfcaa0c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ed03e4f2a848aa95e7d494b20065c1, user_id=84c712377f084cedabfaa4d0a3aab0d2, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.705114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be9d3-af40-4d06-ac48-11ccfcaa0c84 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.723734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:12.725806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:12.748712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb540c-d040-4faf-9da9-905a418c48df admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:12.754510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:12.756116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.756477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.756871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] PATH_INFO: `/v3/projects/df58044081194226ae94d69669c9075b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.759281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df58044081194226ae94d69669c9075b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:12.761296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:12.799852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 987/1992] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:12 2022] PUT /identity/v3/projects/92ed03e4f2a848aa95e7d494b20065c1/users/84c712377f084cedabfaa4d0a3aab0d2/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:12.812196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:12.812483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:12.812765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:12.843560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] MFA Rules not processed for user `84c712377f084cedabfaa4d0a3aab0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:12.844823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:12.932039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df58044081194226ae94d69669c9075b', 'request_id': 'req-4cb88a99-bd84-4daf-bd39-f6da289aaf67'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:12.966315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 988/1993] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:12.969613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.051546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df58044081194226ae94d69669c9075b', 'request_id': 'req-4cb88a99-bd84-4daf-bd39-f6da289aaf67'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.057388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91d22f-7398-4302-9da3-6944623aa1ea None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.066182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df58044081194226ae94d69669c9075b', 'request_id': 'req-4cb88a99-bd84-4daf-bd39-f6da289aaf67'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.088267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] The token cache is being invalidate because project df58044081194226ae94d69669c9075b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:13.088955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.089794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.092142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1006/1994] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:12 2022] DELETE /identity/v3/projects/df58044081194226ae94d69669c9075b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:13.093253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.095142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:13.154425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cab90-7ec5-4a9f-86a2-63153b59aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.155116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cab90-7ec5-4a9f-86a2-63153b59aef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.155464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cab90-7ec5-4a9f-86a2-63153b59aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.155740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cab90-7ec5-4a9f-86a2-63153b59aef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.160550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cab90-7ec5-4a9f-86a2-63153b59aef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.162702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cab90-7ec5-4a9f-86a2-63153b59aef8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.201337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88a99-bd84-4daf-bd39-f6da289aaf67 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.207150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.208341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.208827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.209284 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] PATH_INFO: `/v3/users/5e84c414924f440782549a33165bf739` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.212245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e84c414924f440782549a33165bf739)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.214955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.299550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 989/1995] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:12 2022] POST /identity/v3/projects => generated 365 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:13.302155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.303019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.303695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.337733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:13.340055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:13.490891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 990/1996] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:13.492238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.494717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:13.510096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4581a3-1db1-448d-9756-685b6ec07be9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.516519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a306-528a-4488-bb86-54a823a24a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.517203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a306-528a-4488-bb86-54a823a24a9f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.517482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a306-528a-4488-bb86-54a823a24a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.517816 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a306-528a-4488-bb86-54a823a24a9f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.518567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a306-528a-4488-bb86-54a823a24a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.520923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a306-528a-4488-bb86-54a823a24a9f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.614670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e84c414924f440782549a33165bf739'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.621698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e84c414924f440782549a33165bf739'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.622455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e84c414924f440782549a33165bf739'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.623060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e84c414924f440782549a33165bf739'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.635615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e84c414924f440782549a33165bf739'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:13.652826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 991/1997] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:13 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:13.655553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.655996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.656747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.682090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:13.683499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:13.691636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 992/1998] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:13.692435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.693628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:13.709703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20591d-3e1c-497a-9f80-9a831010136d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.715493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.716305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.717005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.717380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.718300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.719926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.730714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 993/1999] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:13.731746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.741990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d5fea-337b-41e5-8816-a9d604d3e42d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.749963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.750783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.751058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.751326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.752065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:13.752368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.753983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.768398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 994/2000] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:39:13.769223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.780155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa2b9-b73e-4104-9e6b-d25148ec2fc9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.785087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c6555-6732-4ed9-bb22-6f0637d96679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.786986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c6555-6732-4ed9-bb22-6f0637d96679 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.786986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c6555-6732-4ed9-bb22-6f0637d96679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.786986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c6555-6732-4ed9-bb22-6f0637d96679 admin admin] PATH_INFO: `/v3/projects/2a79c76b651f42c79782c1df7a7d3fd4/users/9b222e92a40b47ba9cb98377b722222e/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.790624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1007/2001] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:13 2022] DELETE /identity/v3/users/5e84c414924f440782549a33165bf739 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:13.791192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:13.804426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c6555-6732-4ed9-bb22-6f0637d96679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79c76b651f42c79782c1df7a7d3fd4, user_id=9b222e92a40b47ba9cb98377b722222e, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.810088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c6555-6732-4ed9-bb22-6f0637d96679 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.869986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd652b-f009-4cfa-b5f2-0373669d8e55 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:13.878890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:13.879938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.880255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.880538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.881263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:13.884631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:13.921039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 995/2002] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:13 2022] PUT /identity/v3/projects/2a79c76b651f42c79782c1df7a7d3fd4/users/9b222e92a40b47ba9cb98377b722222e/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:13.921039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:13.921039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:13.921039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:13.947680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:13.948928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:14.021543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 996/2003] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:14.022164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.027623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1008/2004] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:13 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:14.032897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.033211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b7d65-9c41-4c79-b1bd-84295fde3b16 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.112173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f8a97-fdbb-4248-9939-06ad127758f2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.119882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.120581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.120704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.120957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.121190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.121848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.122015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.122383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.122731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.123933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.124068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.131089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.163307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 997/2005] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:14.163307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.169675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:14.234692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1009/2006] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:14 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:14.234692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.244091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092a0e8-0519-4944-bf11-3047f261258b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.249599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.251114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.251114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.251114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] PATH_INFO: `/v3/projects/2a79c76b651f42c79782c1df7a7d3fd4/users/9b222e92a40b47ba9cb98377b722222e/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.255782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79c76b651f42c79782c1df7a7d3fd4, user_id=9b222e92a40b47ba9cb98377b722222e, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.262654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.273358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798045f-592c-49ba-a304-60616cda7224 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.291502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1010/2007] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:14 2022] PUT /identity/v3/projects/2a79c76b651f42c79782c1df7a7d3fd4/users/9b222e92a40b47ba9cb98377b722222e/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:14.291502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.358171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300e23e-4b4c-4387-a72f-2664093cd14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.359055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300e23e-4b4c-4387-a72f-2664093cd14b service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.359532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300e23e-4b4c-4387-a72f-2664093cd14b service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.360062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300e23e-4b4c-4387-a72f-2664093cd14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.376593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300e23e-4b4c-4387-a72f-2664093cd14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.378884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300e23e-4b4c-4387-a72f-2664093cd14b service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.379915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b05fb-ba83-41cd-854a-6a8953aff7d8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.389223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.390467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.390630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 998/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:14.391419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.392213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.392349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.392349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.392549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.393682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.397047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.412241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1011/2009] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:14.417813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.425484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] MFA Rules not processed for user `9b222e92a40b47ba9cb98377b722222e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:14.426864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:14.428746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cac8b8-bbe4-41d9-b5fd-15d8508f9066 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.440303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.441285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.441704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.442164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.447256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.450641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.468732 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1012/2010] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:14.478039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.499118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a4e5b-4c17-4088-a575-e650fd5b474c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.513823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4478c9-8c5a-4b01-97ac-7abdc8dcb03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.515152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4478c9-8c5a-4b01-97ac-7abdc8dcb03b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.515747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4478c9-8c5a-4b01-97ac-7abdc8dcb03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.515945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4478c9-8c5a-4b01-97ac-7abdc8dcb03b admin admin] PATH_INFO: `/v3/projects/6b463944c6064c508255efc9197df1ec/users/9f7f8c343f234ab8a0a39507ce81b656/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.536190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4478c9-8c5a-4b01-97ac-7abdc8dcb03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b463944c6064c508255efc9197df1ec, user_id=9f7f8c343f234ab8a0a39507ce81b656, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.540228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4478c9-8c5a-4b01-97ac-7abdc8dcb03b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.567261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 999/2011] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:14.578459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.580071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:14.650693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35852c3-3f88-4543-8e18-f97244555195 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.655092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.655989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.656294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.656567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.672687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.675185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.677021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1013/2012] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:14 2022] PUT /identity/v3/projects/6b463944c6064c508255efc9197df1ec/users/9f7f8c343f234ab8a0a39507ce81b656/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:14.687623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1000/2013] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:39:14.687955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.688244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.688518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.721943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] MFA Rules not processed for user `9f7f8c343f234ab8a0a39507ce81b656`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:14.723188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:14.802405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1014/2014] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:14.812270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:14.813844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:14.895373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0640a-692f-4145-a8a7-35b492077323 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:14.943691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:14.944343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:14.944621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:14.945477 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:14.954142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:14.955625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:14.964811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1001/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:15.064459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:15.066249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:15.183779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128e5d9-fd5d-434e-8915-3fc3f5a07d78 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:15.189745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:15.190745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:15.191032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:15.191309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] PATH_INFO: `/v3/projects/d0a190826a764372ae7f45ae7511ab41` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:15.192832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a190826a764372ae7f45ae7511ab41)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:15.195030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:15.219330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:15.236547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a3b8f-abc8-42d4-bf69-928894e6ea64 service glance] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:15.243563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:15.244680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:15.244967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:15.245248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] PATH_INFO: `/v3/users/84c712377f084cedabfaa4d0a3aab0d2` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:15.246894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c712377f084cedabfaa4d0a3aab0d2)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:15.248803 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:15.397320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a190826a764372ae7f45ae7511ab41', 'request_id': 'req-39974a10-e888-4042-a5fc-6d8e19075bc5'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.608218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a190826a764372ae7f45ae7511ab41', 'request_id': 'req-39974a10-e888-4042-a5fc-6d8e19075bc5'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.619335 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a190826a764372ae7f45ae7511ab41', 'request_id': 'req-39974a10-e888-4042-a5fc-6d8e19075bc5'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.627914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c712377f084cedabfaa4d0a3aab0d2'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.642393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] The token cache is being invalidate because project d0a190826a764372ae7f45ae7511ab41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:15.642393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.653386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.655407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1015/2016] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:15 2022] DELETE /identity/v3/projects/d0a190826a764372ae7f45ae7511ab41 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:15.657930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c712377f084cedabfaa4d0a3aab0d2'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.659375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:15.664219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c712377f084cedabfaa4d0a3aab0d2'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.664355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:15.674349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c712377f084cedabfaa4d0a3aab0d2'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.767307 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39974a10-e888-4042-a5fc-6d8e19075bc5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:15.775437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:15.776338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:15.776663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:15.776947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] PATH_INFO: `/v3/users/45bd120e8c3d4cecb7b0c3ef1eec9084` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:15.779867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bd120e8c3d4cecb7b0c3ef1eec9084)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:15.782404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:15.793765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d4677328-402e-496c-a3ed-374dcab0be9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c712377f084cedabfaa4d0a3aab0d2'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:15.802825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1002/2017] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:15 2022] DELETE /identity/v3/users/84c712377f084cedabfaa4d0a3aab0d2 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:15.809114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:15.809696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:15.813092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:15.831142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:15.833395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:15.922285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1003/2018] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:15.932462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:15.935033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:16.008933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7052-e778-4ca0-8ef7-520a91ac6bd9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:16.013051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:16.013698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:16.013973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:16.014275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:16.030577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:16.033192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:16.052146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1004/2019] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:16.138726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bd120e8c3d4cecb7b0c3ef1eec9084'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:16.149294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bd120e8c3d4cecb7b0c3ef1eec9084'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:16.150480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bd120e8c3d4cecb7b0c3ef1eec9084'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:16.151227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bd120e8c3d4cecb7b0c3ef1eec9084'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:16.168419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bd120e8c3d4cecb7b0c3ef1eec9084'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:16.402349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1016/2020] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:15 2022] DELETE /identity/v3/users/45bd120e8c3d4cecb7b0c3ef1eec9084 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:16.849956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:16.851646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:16.865888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57e73-eb14-4d2a-ae74-c1237ec3e2b5 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:17.016180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:17.017074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:17.018579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:17.020753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] PATH_INFO: `/v3/projects/92ed03e4f2a848aa95e7d494b20065c1` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:17.023185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ed03e4f2a848aa95e7d494b20065c1)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:17.025214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:17.210546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:17.212323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:17.236559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90101f-b85b-4cce-9aa4-f3ed18e32194 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:17.238517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ed03e4f2a848aa95e7d494b20065c1', 'request_id': 'req-1ce93c94-70f5-44dc-9061-56acca6f66e1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.383167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:17.384198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:17.384646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:17.385023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] PATH_INFO: `/v3/projects/69c39823356b4e4da15d78f08658fd0f` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:17.388058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c39823356b4e4da15d78f08658fd0f)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:17.390676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:17.416672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ed03e4f2a848aa95e7d494b20065c1', 'request_id': 'req-1ce93c94-70f5-44dc-9061-56acca6f66e1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.427926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ed03e4f2a848aa95e7d494b20065c1', 'request_id': 'req-1ce93c94-70f5-44dc-9061-56acca6f66e1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.444451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] The token cache is being invalidate because project 92ed03e4f2a848aa95e7d494b20065c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:17.444869 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.445604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.450385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1005/2021] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:16 2022] DELETE /identity/v3/projects/92ed03e4f2a848aa95e7d494b20065c1 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:17.452553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:17.455636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:17.471303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93c94-70f5-44dc-9061-56acca6f66e1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:17.477078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:17.477940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:17.478309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:17.478602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] PATH_INFO: `/v3/users/9b222e92a40b47ba9cb98377b722222e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:17.479847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b222e92a40b47ba9cb98377b722222e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:17.486247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:17.694753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c39823356b4e4da15d78f08658fd0f', 'request_id': 'req-439a20d1-311b-4fc9-8171-ec34192e5e32'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.794058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b222e92a40b47ba9cb98377b722222e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.816099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b222e92a40b47ba9cb98377b722222e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.816900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b222e92a40b47ba9cb98377b722222e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.825620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b222e92a40b47ba9cb98377b722222e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.854875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c39823356b4e4da15d78f08658fd0f', 'request_id': 'req-439a20d1-311b-4fc9-8171-ec34192e5e32'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.874630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c39823356b4e4da15d78f08658fd0f', 'request_id': 'req-439a20d1-311b-4fc9-8171-ec34192e5e32'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.896370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] The token cache is being invalidate because project 69c39823356b4e4da15d78f08658fd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:17.896769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.897554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-439a20d1-311b-4fc9-8171-ec34192e5e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:17.900087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1017/2022] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:17 2022] DELETE /identity/v3/projects/69c39823356b4e4da15d78f08658fd0f => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:17.907490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba31c-40be-4709-a1df-d39a994ceebf None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:17.907773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba31c-40be-4709-a1df-d39a994ceebf None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:17.908052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba31c-40be-4709-a1df-d39a994ceebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:17.930939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-963ba31c-40be-4709-a1df-d39a994ceebf None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:17.932463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-963ba31c-40be-4709-a1df-d39a994ceebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:18.019112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1018/2023] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:18.035046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.035456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.035746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.058898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:18.060253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:18.071186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1019/2024] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:18.076428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:18.087698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46715-d3d2-4312-b2a9-c1f664bd003b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:18.093669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:18.094504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.095049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.095365 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.096272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:18.096657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:18.098723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:18.114006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1020/2025] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:18.114236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b222e92a40b47ba9cb98377b722222e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:18.118755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:18.121505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:18.128203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1006/2026] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:17 2022] DELETE /identity/v3/users/9b222e92a40b47ba9cb98377b722222e => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:18.147853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6f1e-2dbf-4098-98cf-13415a490fc8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:18.220847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:18.221607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.221863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.222146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.222927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:18.224941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:18.536799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1021/2027] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:18.545535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:18.560640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e90aa-6a4b-41fc-adde-245eab125765 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:18.628123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:18.629347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.629876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.634003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.634003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:18.636135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:18.813752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1007/2028] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:18 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:18.825936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:18.841128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c56450-a84b-48ac-9f85-3512f4b0665d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:18.849107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:18.850450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.851072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.851478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.852292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:18.854111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:18.869421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1022/2029] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:18.873300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:18.888509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37b144-aaf8-4764-b144-054f147daaf0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:18.893813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82be40-b5f1-4f6d-b9d7-9b438d66a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:18.894731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82be40-b5f1-4f6d-b9d7-9b438d66a041 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.895097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82be40-b5f1-4f6d-b9d7-9b438d66a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.895505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82be40-b5f1-4f6d-b9d7-9b438d66a041 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.896323 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82be40-b5f1-4f6d-b9d7-9b438d66a041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:18.898730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82be40-b5f1-4f6d-b9d7-9b438d66a041 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:18.915245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1008/2030] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:18.922108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:18.939837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae2b73-a8aa-4e73-8a6c-c7e07e097178 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:18.949442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:18.951191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:18.951740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:18.952224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] PATH_INFO: `/v3/projects/026a1bbd34a4462dbb4afb5be94c028e/users/76b2f9f7de024161baf0b891cc035235/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:18.975507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=026a1bbd34a4462dbb4afb5be94c028e, user_id=76b2f9f7de024161baf0b891cc035235, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:18.978813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.112282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1023/2031] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:18 2022] PUT /identity/v3/projects/026a1bbd34a4462dbb4afb5be94c028e/users/76b2f9f7de024161baf0b891cc035235/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:19.122731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.123339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.123339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.153937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.155891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:19.162188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] MFA Rules not processed for user `76b2f9f7de024161baf0b891cc035235`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:19.164391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:19.236275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957a347-ec98-41ac-bc61-b6994f0f02ee admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.246829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.248485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.249216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.249545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] PATH_INFO: `/v3/projects/2a79c76b651f42c79782c1df7a7d3fd4` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.252163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a79c76b651f42c79782c1df7a7d3fd4)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.253647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1009/2032] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:19.256169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.265923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.277123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7260f3-a76a-499d-84ad-328957b39dba None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.281954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.282842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.283211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.283588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.284567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.286877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.492634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1010/2033] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:19.494046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.499368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a79c76b651f42c79782c1df7a7d3fd4', 'request_id': 'req-69b90ece-dbe4-45e6-bd6d-5e88e1551216'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:19.606921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f73025-b6fc-4705-bc53-37ab1cc5afab admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.612627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.613337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.613649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.613927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.614723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.616921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.622686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a79c76b651f42c79782c1df7a7d3fd4', 'request_id': 'req-69b90ece-dbe4-45e6-bd6d-5e88e1551216'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:19.635576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a79c76b651f42c79782c1df7a7d3fd4', 'request_id': 'req-69b90ece-dbe4-45e6-bd6d-5e88e1551216'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:19.652336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] The token cache is being invalidate because project 2a79c76b651f42c79782c1df7a7d3fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:19.652630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:19.653328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-69b90ece-dbe4-45e6-bd6d-5e88e1551216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:19.654948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1024/2034] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:19 2022] DELETE /identity/v3/projects/2a79c76b651f42c79782c1df7a7d3fd4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:19.660778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a34a-4230-416b-9264-32fc953b7dd3 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.661063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a34a-4230-416b-9264-32fc953b7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.661339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0a34a-4230-416b-9264-32fc953b7dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.681161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-41f0a34a-4230-416b-9264-32fc953b7dd3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:19.682473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-41f0a34a-4230-416b-9264-32fc953b7dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:19.690813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1025/2035] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:19.700795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.701309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.701672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.722642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:19.723868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:19.732230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1026/2036] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:19.737059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.750533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a3a8-b411-426c-a55e-331f4226763d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.757931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.758781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.758919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.759186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.759944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:19.760253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.761904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.775295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1027/2037] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:19.781911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1011/2038] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:19.782164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.783228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.785952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:19.793758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e583d-2d3f-4d49-a991-e7a5ea560279 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.799685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.800359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.800642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.801145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.802007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.803988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.807111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69be4b-877d-4b32-b1c2-154f5b369e12 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.813751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.814769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.815214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.815594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.816420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.818306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.830966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1012/2039] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:19.835093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.845788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9bebb-63ed-4001-b8f8-b4ff86faf168 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.850722 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:19.851678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:19.851957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:19.852236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] PATH_INFO: `/v3/projects/bd7647e0d15844bda7ce4c1e029d1758/users/5b6002b04bf14ef9bca50f2343bc32b1/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:19.875315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7647e0d15844bda7ce4c1e029d1758, user_id=5b6002b04bf14ef9bca50f2343bc32b1, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:19.878014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:19.916759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1028/2040] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:19.920819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:19.994896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03ebef-7180-4ef8-98ad-2c216659c0a0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:19.999834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.000505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.000784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.001061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.001771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.003740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.036040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1013/2041] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:19 2022] PUT /identity/v3/projects/bd7647e0d15844bda7ce4c1e029d1758/users/5b6002b04bf14ef9bca50f2343bc32b1/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:20.039942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.108441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652be2-b71e-47fa-b6fd-9e68e241d015 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.121591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.122468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.122612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.122879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.123875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.137783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1029/2042] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:19 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:20.141327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.162826 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.178574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9808f-ac40-4a21-8887-e4d14722e936 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.178801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1014/2043] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:20.184598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.191478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.192424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.192882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.193404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.194536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.197318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.211342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ac5d-d01f-4155-908b-e195c7dec2df admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.218783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1030/2044] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:20.219140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78896b23-beab-45a8-9d50-9daad6c7a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.220216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78896b23-beab-45a8-9d50-9daad6c7a4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.220622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78896b23-beab-45a8-9d50-9daad6c7a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.221021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78896b23-beab-45a8-9d50-9daad6c7a4ac admin admin] PATH_INFO: `/v3/projects/bd7647e0d15844bda7ce4c1e029d1758/users/5b6002b04bf14ef9bca50f2343bc32b1/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.223497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.224499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78896b23-beab-45a8-9d50-9daad6c7a4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7647e0d15844bda7ce4c1e029d1758, user_id=5b6002b04bf14ef9bca50f2343bc32b1, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.233153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78896b23-beab-45a8-9d50-9daad6c7a4ac admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.240198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201fe43-e612-41ec-a6d5-9a9d8529793a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.252293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1015/2045] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:20 2022] PUT /identity/v3/projects/bd7647e0d15844bda7ce4c1e029d1758/users/5b6002b04bf14ef9bca50f2343bc32b1/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:20.254924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.256022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.259550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.260065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.264621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.282827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.287170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.287170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.287170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.316571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1031/2046] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:20.323469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.348270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] MFA Rules not processed for user `5b6002b04bf14ef9bca50f2343bc32b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:20.348544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60885014-6b0c-4b1a-9eba-25ce85eb87c1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.350421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:20.439569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.440467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.440758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.441042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] PATH_INFO: `/v3/projects/dff2384ab41246569dfd6041c018af6c/users/cd5ba57a44d74469ae804dcdafb2f17d/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.451947 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1016/2047] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:20.464383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.464789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff2384ab41246569dfd6041c018af6c, user_id=cd5ba57a44d74469ae804dcdafb2f17d, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.465991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:20.467844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.565168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cefa-db26-4da7-a4a4-e787f8ab9ab1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.571268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3140d3-789f-4f06-a586-205e433495ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.571929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3140d3-789f-4f06-a586-205e433495ed service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.572255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3140d3-789f-4f06-a586-205e433495ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.572529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3140d3-789f-4f06-a586-205e433495ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.582587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3140d3-789f-4f06-a586-205e433495ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.584048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3140d3-789f-4f06-a586-205e433495ed service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.596581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1017/2048] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:20.613531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1032/2049] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:20 2022] PUT /identity/v3/projects/dff2384ab41246569dfd6041c018af6c/users/cd5ba57a44d74469ae804dcdafb2f17d/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:20.619668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.620070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.620384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.643221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.651640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:20.655297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:20.763723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1018/2050] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:20.774973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:20.777373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:20.781480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b20ad-b109-47cb-913a-51f18577f200 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.786484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.787369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.787650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.787913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] PATH_INFO: `/v3/users/76b2f9f7de024161baf0b891cc035235` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.789221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b2f9f7de024161baf0b891cc035235)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.791224 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.847885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c85c-66ed-4179-9223-3e2d856a483f None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:20.856594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0ec41-2de2-487a-9e1f-c440e16abd89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:20.857371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0ec41-2de2-487a-9e1f-c440e16abd89 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:20.857727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0ec41-2de2-487a-9e1f-c440e16abd89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:20.858398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0ec41-2de2-487a-9e1f-c440e16abd89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:20.872303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0ec41-2de2-487a-9e1f-c440e16abd89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:20.875204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0ec41-2de2-487a-9e1f-c440e16abd89 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:20.896272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1019/2051] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:21.046471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b2f9f7de024161baf0b891cc035235'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:21.053799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b2f9f7de024161baf0b891cc035235'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:21.055487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b2f9f7de024161baf0b891cc035235'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:21.056408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b2f9f7de024161baf0b891cc035235'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:21.083602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b2f9f7de024161baf0b891cc035235'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:21.373726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1033/2052] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:20 2022] DELETE /identity/v3/users/76b2f9f7de024161baf0b891cc035235 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:21.378578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:21.379159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:21.379391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:21.402033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:21.403534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:21.583549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1020/2053] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:21.612404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:21.614172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:21.785430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824918-2c2c-4df2-91f2-fb2719ff9bbd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:21.790724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff87fd9-0fa9-4db0-98f7-3c16dcb06538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:21.791513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff87fd9-0fa9-4db0-98f7-3c16dcb06538 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:21.791871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff87fd9-0fa9-4db0-98f7-3c16dcb06538 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:21.792223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff87fd9-0fa9-4db0-98f7-3c16dcb06538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:21.802596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff87fd9-0fa9-4db0-98f7-3c16dcb06538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:21.804148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff87fd9-0fa9-4db0-98f7-3c16dcb06538 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:21.821674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1034/2054] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:23.461858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:23.463954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:23.481990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8f9a3-1a9d-4315-a246-2e58c4a39371 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:23.495008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:23.496948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:23.497506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:23.498354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] PATH_INFO: `/v3/projects/026a1bbd34a4462dbb4afb5be94c028e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:23.509109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] RBAC: Authorizing `identity:delete_project(project_id=026a1bbd34a4462dbb4afb5be94c028e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:23.510357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:23.769611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026a1bbd34a4462dbb4afb5be94c028e', 'request_id': 'req-f9340ac6-65f5-454e-9419-2f24d484667e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:23.815173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:23.816040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:23.816572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:23.847722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] MFA Rules not processed for user `cd5ba57a44d74469ae804dcdafb2f17d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:23.849601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:23.927191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026a1bbd34a4462dbb4afb5be94c028e', 'request_id': 'req-f9340ac6-65f5-454e-9419-2f24d484667e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:23.938558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026a1bbd34a4462dbb4afb5be94c028e', 'request_id': 'req-f9340ac6-65f5-454e-9419-2f24d484667e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:23.964362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] The token cache is being invalidate because project 026a1bbd34a4462dbb4afb5be94c028e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:23.964654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:23.966279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:23.966988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1035/2055] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:23.972253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:23.977954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1021/2056] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:23 2022] DELETE /identity/v3/projects/026a1bbd34a4462dbb4afb5be94c028e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:23.980670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:23.980926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:23.982688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:24.077202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9340ac6-65f5-454e-9419-2f24d484667e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:24.105610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce8d49-123b-4de7-980d-71a932e9e1f4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:24.108797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:24.110126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:24.110480 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:24.110671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] PATH_INFO: `/v3/users/5b6002b04bf14ef9bca50f2343bc32b1` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:24.111491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:24.112073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6002b04bf14ef9bca50f2343bc32b1)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:24.112177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:24.112436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:24.112710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:24.113417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:24.114551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:24.115423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:24.354110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1036/2057] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:24.360037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:24.362000 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:24.446691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0552-5ef0-4c6e-92f7-5ecb75df2dd1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:24.451742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:24.452424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:24.452710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:24.452990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:24.453722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:24.455762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:24.562186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6002b04bf14ef9bca50f2343bc32b1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:24.579087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6002b04bf14ef9bca50f2343bc32b1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:24.580265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6002b04bf14ef9bca50f2343bc32b1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:24.589319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1037/2058] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:24 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:24.596004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:24.596750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6002b04bf14ef9bca50f2343bc32b1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:24.610477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a7d37-78a2-4824-852e-5126c3d701bf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:24.616496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:24.618015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:24.618439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:24.618836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:24.619682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:24.621686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:24.633853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1038/2059] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:24.640074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:24.651187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0ceec-a802-4e0a-b614-d562cef7557c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:24.656599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:24.658189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:24.658804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:24.659360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] PATH_INFO: `/v3/projects/641c2aa6c9b9462a9b09db1c18c96268/users/9e320fc242184b9295cdc8bee62a96b7/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:24.698439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641c2aa6c9b9462a9b09db1c18c96268, user_id=9e320fc242184b9295cdc8bee62a96b7, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:24.699545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6002b04bf14ef9bca50f2343bc32b1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:24.703415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:24.726345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1022/2060] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:23 2022] DELETE /identity/v3/users/5b6002b04bf14ef9bca50f2343bc32b1 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:24.891407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1039/2061] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:24 2022] PUT /identity/v3/projects/641c2aa6c9b9462a9b09db1c18c96268/users/9e320fc242184b9295cdc8bee62a96b7/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:24.895774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:24.897535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:24.993261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b4b07-749f-4ea3-9578-4518e27d684f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:25.096094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:25.097006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:25.097383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:25.097755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:25.098654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:25.100554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:25.128977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1023/2062] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:25.131712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:25.148554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afe112-51be-4b39-aaf9-2e28cf81f552 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:25.157745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455325-9725-47fa-beb6-aba34ac6ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:25.159527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455325-9725-47fa-beb6-aba34ac6ac1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:25.160104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455325-9725-47fa-beb6-aba34ac6ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:25.160600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455325-9725-47fa-beb6-aba34ac6ac1f admin admin] PATH_INFO: `/v3/projects/641c2aa6c9b9462a9b09db1c18c96268/users/9e320fc242184b9295cdc8bee62a96b7/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:25.164830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455325-9725-47fa-beb6-aba34ac6ac1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=641c2aa6c9b9462a9b09db1c18c96268, user_id=9e320fc242184b9295cdc8bee62a96b7, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:25.170910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455325-9725-47fa-beb6-aba34ac6ac1f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:25.205399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1040/2063] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:25 2022] PUT /identity/v3/projects/641c2aa6c9b9462a9b09db1c18c96268/users/9e320fc242184b9295cdc8bee62a96b7/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:25.310747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:25.313771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:25.344266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0e98-5b68-442b-90d3-a979ba65d619 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:25.451296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:25.452632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:25.452994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:25.453344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] PATH_INFO: `/v3/projects/bd7647e0d15844bda7ce4c1e029d1758` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:25.455775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7647e0d15844bda7ce4c1e029d1758)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:25.458161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:25.575098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:25.575642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:25.576144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:25.600995 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:25.603836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:25.653010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7647e0d15844bda7ce4c1e029d1758', 'request_id': 'req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:25.681468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1041/2064] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:25.737304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:25.740576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:25.751695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7647e0d15844bda7ce4c1e029d1758', 'request_id': 'req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:25.762966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7647e0d15844bda7ce4c1e029d1758', 'request_id': 'req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:25.796681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] The token cache is being invalidate because project bd7647e0d15844bda7ce4c1e029d1758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:25.797248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:25.809248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-d18ce54f-26c3-468b-bf76-e5cc8fab09c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:25.809248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1024/2065] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:25 2022] DELETE /identity/v3/projects/bd7647e0d15844bda7ce4c1e029d1758 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:25.820044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf89777-83d0-40ec-91ae-0dfedd2ad436 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:25.820578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf89777-83d0-40ec-91ae-0dfedd2ad436 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:25.821095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf89777-83d0-40ec-91ae-0dfedd2ad436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:25.856675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-faf89777-83d0-40ec-91ae-0dfedd2ad436 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:25.858977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-faf89777-83d0-40ec-91ae-0dfedd2ad436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:25.881818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b06443-1c48-42dd-9635-097c9b5d0bde None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:25.935539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1025/2066] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:25.943863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:25.944325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:25.944677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:25.965922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:25.967403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:25.981711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1026/2067] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:25.987763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:25.997773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac9fea-982f-4827-b94f-e4bf8685c441 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:26.002378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.003572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.003740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.003876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.004068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.004200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.004361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.004461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.004760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:26.005139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.006190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:26.006860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.022681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1027/2068] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:26.028876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:26.042985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bdfb-e8ea-4126-ad16-37bed6321db7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:26.053133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.053901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.054191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.055756 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.056579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.058753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.114075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.115888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.125875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1042/2069] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:39:26.195627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1028/2070] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:26 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:26.197112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:26.213709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824f15-b289-4f82-b757-2034025c576f service swift] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:26.312803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.313502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.313914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.314197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.314934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.316844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.553958 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1043/2071] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:26 2022] POST /identity/v3/users => generated 301 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:26.554939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:26.568606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7510-ab24-4319-80d3-ae79225ea509 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:26.579318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.580088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.580415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.581380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.582550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.584404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.598455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1029/2072] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:26.602820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:26.615937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c4ef4-e6c1-4753-8bfd-265d9fd8c061 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:26.622100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef4d02-acee-4d39-bf00-185870dbc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.622813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef4d02-acee-4d39-bf00-185870dbc0af admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.623309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef4d02-acee-4d39-bf00-185870dbc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.623593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef4d02-acee-4d39-bf00-185870dbc0af admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.624856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef4d02-acee-4d39-bf00-185870dbc0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.626985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef4d02-acee-4d39-bf00-185870dbc0af admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.644511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1044/2073] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:26.645448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:26.663880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec904-e772-4aff-bc12-7d6931d2c05d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:26.671230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:26.672210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.675783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.675783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] PATH_INFO: `/v3/projects/d2acf3b581c846d0b45087644dd8e74e/users/b2f178f89db64ad09573a7c8d12c62d4/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.693400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2acf3b581c846d0b45087644dd8e74e, user_id=b2f178f89db64ad09573a7c8d12c62d4, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:26.697382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:26.788708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1030/2074] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:26 2022] PUT /identity/v3/projects/d2acf3b581c846d0b45087644dd8e74e/users/b2f178f89db64ad09573a7c8d12c62d4/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:26.799032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:26.799477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:26.799769 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:26.833215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] MFA Rules not processed for user `b2f178f89db64ad09573a7c8d12c62d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:26.834481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:26.928465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1045/2075] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:26.936168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.057642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54781d0b-1c50-4751-9103-dc34c94d1f8d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.065845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411d4b6-97bb-4240-80a0-b3b446a1ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.067102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411d4b6-97bb-4240-80a0-b3b446a1ba26 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.067608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411d4b6-97bb-4240-80a0-b3b446a1ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.068136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411d4b6-97bb-4240-80a0-b3b446a1ba26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.069493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411d4b6-97bb-4240-80a0-b3b446a1ba26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.074180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411d4b6-97bb-4240-80a0-b3b446a1ba26 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:27.227235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1031/2076] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:26 2022] POST /identity/v3/projects => generated 399 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:27.232006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.243810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733afd8-680c-48c3-9809-cd14fb540dee None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.314623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3a51d-3b59-44c5-bf4a-90d5f1eba893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.315306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a51d-3b59-44c5-bf4a-90d5f1eba893 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.315590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a51d-3b59-44c5-bf4a-90d5f1eba893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.315867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a51d-3b59-44c5-bf4a-90d5f1eba893 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.316583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3a51d-3b59-44c5-bf4a-90d5f1eba893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.318609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3a51d-3b59-44c5-bf4a-90d5f1eba893 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:27.479919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.479919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.480562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.516223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:27.518389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:27.545075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1046/2077] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:27 2022] POST /identity/v3/users => generated 306 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:27.547708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.548213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.548715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.593037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] MFA Rules not processed for user `9e320fc242184b9295cdc8bee62a96b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:27.594298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:27.617842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1032/2078] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jan 10 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:27.618552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.631831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831ece7-0c29-43cb-8188-224792ae5981 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.642320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.643703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.644542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.644842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.645797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.647632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:27.669716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1033/2079] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:27.671271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.673086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:27.696237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1047/2080] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:27.697060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.714053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df94ec0-7940-487c-a17c-8ca94562fca8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.718888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.719943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.720264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.720545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] PATH_INFO: `/v3/projects/474cb9aae80f44a180a399240192a45d/users/98572e8109894ccdb72c1fa2a495c0b2/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.741169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474cb9aae80f44a180a399240192a45d, user_id=98572e8109894ccdb72c1fa2a495c0b2, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.744208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:27.783996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41262218-d940-4689-8a0c-05eb4fef437c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.790416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c79d39-5c92-450f-9157-441c649209df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.791064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79d39-5c92-450f-9157-441c649209df service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.791360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79d39-5c92-450f-9157-441c649209df service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.791632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79d39-5c92-450f-9157-441c649209df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.802374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c79d39-5c92-450f-9157-441c649209df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.804014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c79d39-5c92-450f-9157-441c649209df service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:27.813170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1034/2081] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:39:27.814008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c79d39-5c92-450f-9157-441c649209df service swift] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.815747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-76c79d39-5c92-450f-9157-441c649209df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:27.834932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1048/2082] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:27 2022] PUT /identity/v3/projects/474cb9aae80f44a180a399240192a45d/users/98572e8109894ccdb72c1fa2a495c0b2/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:27.841235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.911453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c79d39-5c92-450f-9157-441c649209df service swift] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.928778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0f9b4-d759-4b76-bc64-7c3cb78ffa98 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.941066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.941865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.942239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.942849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.949244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.951062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:27.962961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1049/2083] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:27.967180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:27.974198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.974921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.975361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.975625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.977709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:27.987794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a23c-50ab-433e-82ff-0995ff23a6e3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:27.992987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41ae6f-3e06-452b-9636-2eb72d858340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:27.993865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41ae6f-3e06-452b-9636-2eb72d858340 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:27.994176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41ae6f-3e06-452b-9636-2eb72d858340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:27.994487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41ae6f-3e06-452b-9636-2eb72d858340 admin admin] PATH_INFO: `/v3/projects/474cb9aae80f44a180a399240192a45d/users/98572e8109894ccdb72c1fa2a495c0b2/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:27.996457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41ae6f-3e06-452b-9636-2eb72d858340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474cb9aae80f44a180a399240192a45d, user_id=98572e8109894ccdb72c1fa2a495c0b2, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:27.999235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41ae6f-3e06-452b-9636-2eb72d858340 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:28.015033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1050/2084] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:27 2022] PUT /identity/v3/projects/474cb9aae80f44a180a399240192a45d/users/98572e8109894ccdb72c1fa2a495c0b2/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:28.027259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:28.027665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:28.028043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:28.049539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:28.054389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:28.062541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] MFA Rules not processed for user `98572e8109894ccdb72c1fa2a495c0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:28.064669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:28.077532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1035/2085] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:28.152248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1051/2086] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:28.163166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:28.165587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:28.178425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac895d-4bd1-4822-93ad-1725fca977a7 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:28.265414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d018b1-894e-4b1c-a603-402878e6b6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:28.266077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d018b1-894e-4b1c-a603-402878e6b6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:28.266387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d018b1-894e-4b1c-a603-402878e6b6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:28.266666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d018b1-894e-4b1c-a603-402878e6b6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:28.277588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d018b1-894e-4b1c-a603-402878e6b6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:28.279102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d018b1-894e-4b1c-a603-402878e6b6a0 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:28.290391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1036/2087] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:28.783646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:28.801166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6af2-eb9d-4d69-b0e6-6fe2d5b7d3c3 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:28.817446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:28.817446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:28.817446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:28.817446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:28.878778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:28.881082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:28.897957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1052/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:29.400000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f2d2-7a14-4761-860a-e07f30d913d3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:29.400622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f2d2-7a14-4761-860a-e07f30d913d3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:29.400622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f2d2-7a14-4761-860a-e07f30d913d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:29.417919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7359f2d2-7a14-4761-860a-e07f30d913d3 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:29.419166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7359f2d2-7a14-4761-860a-e07f30d913d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:29.476680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1037/2089] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:39:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:29.489087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:29.562231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9578d0-f7c8-4180-82a8-334cc33c5efd service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:29.567515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:29.568171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:29.568454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:29.568737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:29.578544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:29.667756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:29.667756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1053/2090] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:39:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:39:31.025230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:31.026167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:31.026735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:31.080856 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:31.082100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:31.123303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1038/2091] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jan 10 11:39:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:31.137481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:31.210194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5466d-8319-405a-bb45-4e6228f5b969 service swift] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:31.211207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:31.211867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:31.212152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:31.212426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:31.221658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:31.223473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:31.232045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1054/2092] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:39:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:39:31.479814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:31.490005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8ed5-1103-41b9-88c3-a53a5e4d5a37 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:31.494443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:31.506683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:31.506683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:31.506683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:31.574742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:31.577066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:31.590665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1039/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:36.525983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:36.609295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6fd8-771b-4b9e-9977-d38f69b68d95 service swift] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:36.613924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:36.614799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:36.615075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:36.615344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] PATH_INFO: `/v3/users/b2f178f89db64ad09573a7c8d12c62d4` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:36.616565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f178f89db64ad09573a7c8d12c62d4)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:36.618512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:36.971759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f178f89db64ad09573a7c8d12c62d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:36.981399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:36.983870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:36.993898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f178f89db64ad09573a7c8d12c62d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:36.995729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f178f89db64ad09573a7c8d12c62d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:36.997918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f178f89db64ad09573a7c8d12c62d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.022329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c52752-40ee-47b5-9750-f54854fc58a1 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:37.029379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:37.030563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:37.031050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:37.031428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] PATH_INFO: `/v3/users/fbbc21f8524046df82e09f3e5628213e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:37.032453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0b6bd87f-f9d3-487f-876f-45e6018c56c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f178f89db64ad09573a7c8d12c62d4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.033320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbc21f8524046df82e09f3e5628213e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:37.036401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:37.125926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1055/2094] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:36 2022] DELETE /identity/v3/users/b2f178f89db64ad09573a7c8d12c62d4 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:37.130833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:37.131118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:37.131398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:37.159063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:37.160903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:37.218828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1056/2095] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:37.230682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:37.232206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:37.328688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfbc25-0083-4e39-a4bc-38280b91a5a4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:37.332638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4464-b452-4488-9803-56e2c213fb0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:37.333311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4464-b452-4488-9803-56e2c213fb0d service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:37.333601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4464-b452-4488-9803-56e2c213fb0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:37.333904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4464-b452-4488-9803-56e2c213fb0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:37.349722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4464-b452-4488-9803-56e2c213fb0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:37.350627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbc21f8524046df82e09f3e5628213e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.353945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4464-b452-4488-9803-56e2c213fb0d service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:37.365122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1057/2096] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:39:37.366568 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbc21f8524046df82e09f3e5628213e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.368708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbc21f8524046df82e09f3e5628213e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.376554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbc21f8524046df82e09f3e5628213e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.469210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbc21f8524046df82e09f3e5628213e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:37.477085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1040/2097] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:36 2022] DELETE /identity/v3/users/fbbc21f8524046df82e09f3e5628213e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:37.481855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:37.482252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:37.482603 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:37.501786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:37.503050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:37.577900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1058/2098] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:37.593726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:37.595878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:37.656021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74eb2-d6ed-4e87-99f6-70c71060d811 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:37.660024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:37.665432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:37.665432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:37.665432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:37.672501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:37.673952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:37.685658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1041/2099] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:37.898486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:37.902852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:37.921214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b56644-846d-4033-b1c3-66c14320eec5 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:37.926411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:37.927426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:37.928317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:37.928317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] PATH_INFO: `/v3/projects/d2acf3b581c846d0b45087644dd8e74e` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:37.929438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2acf3b581c846d0b45087644dd8e74e)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:37.932234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:38.014004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:38.015609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:38.053131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4085a-ba74-4a41-880e-fdc1a2705422 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:38.061549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:38.063445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.064212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.064844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] PATH_INFO: `/v3/projects/51d2f537a79a40f793f17573c3c26ba7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:38.068605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d2f537a79a40f793f17573c3c26ba7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:38.071525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:38.146045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2acf3b581c846d0b45087644dd8e74e', 'request_id': 'req-a0baec79-8568-41f5-837f-54a9bd74e021'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.287706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d2f537a79a40f793f17573c3c26ba7', 'request_id': 'req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.321045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2acf3b581c846d0b45087644dd8e74e', 'request_id': 'req-a0baec79-8568-41f5-837f-54a9bd74e021'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.328598 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2acf3b581c846d0b45087644dd8e74e', 'request_id': 'req-a0baec79-8568-41f5-837f-54a9bd74e021'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.342747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] The token cache is being invalidate because project d2acf3b581c846d0b45087644dd8e74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:38.343045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.344316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.345977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1059/2100] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:37 2022] DELETE /identity/v3/projects/d2acf3b581c846d0b45087644dd8e74e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:38.350038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:38.351518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:38.418670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baec79-8568-41f5-837f-54a9bd74e021 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:38.468513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d2f537a79a40f793f17573c3c26ba7', 'request_id': 'req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.473190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:38.477848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.477848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.478080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d2f537a79a40f793f17573c3c26ba7', 'request_id': 'req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.478189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] PATH_INFO: `/v3/users/98572e8109894ccdb72c1fa2a495c0b2` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:38.478189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=98572e8109894ccdb72c1fa2a495c0b2)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:38.478189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:38.486176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] The token cache is being invalidate because project 51d2f537a79a40f793f17573c3c26ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:38.486755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.487424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-662e1c4a-1cc9-4d7f-adf1-35b4fdf212da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.488973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1042/2101] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:38 2022] DELETE /identity/v3/projects/51d2f537a79a40f793f17573c3c26ba7 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:38.496155 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc96d2e-9cb2-4aad-8852-b50a8b8f96b5 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.496443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc96d2e-9cb2-4aad-8852-b50a8b8f96b5 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.496721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc96d2e-9cb2-4aad-8852-b50a8b8f96b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:38.538509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0dc96d2e-9cb2-4aad-8852-b50a8b8f96b5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:38.540348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0dc96d2e-9cb2-4aad-8852-b50a8b8f96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:38.548274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1043/2102] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:38.556147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.556437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.556718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:38.575804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:38.577017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:38.587023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1044/2103] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:38.591739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:38.601479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f41f8-18d5-48bf-ba69-27220874c7ff None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:38.606771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:38.607446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.607726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.607999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:38.609008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:38.609309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:38.611064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:38.623237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1045/2104] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:39:38.627733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:38.638869 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ecce9-065e-4efb-aaf4-238f14103c08 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:38.644277 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:38.644931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.645212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.645495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:38.646265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:38.648278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:38.729343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98572e8109894ccdb72c1fa2a495c0b2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.737324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98572e8109894ccdb72c1fa2a495c0b2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.738580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98572e8109894ccdb72c1fa2a495c0b2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.739301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98572e8109894ccdb72c1fa2a495c0b2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.755770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98572e8109894ccdb72c1fa2a495c0b2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:38.842588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1046/2105] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:38 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:38.846646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:38.848327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:38.890451 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1060/2106] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:38 2022] DELETE /identity/v3/users/98572e8109894ccdb72c1fa2a495c0b2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:38.919520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b5ba0-8487-495a-93fc-6dfe96e1d56e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:38.997695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:38.999135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:38.999416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:38.999695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.000418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:39.002395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:39.129860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1047/2107] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:38 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:39.130907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:39.142688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717675f-3f21-4d18-ab0f-edb96ccc5fbd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:39.151868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:39.152789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.153088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.153368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.154123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:39.155799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:39.180351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1061/2108] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:39.184304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:39.196984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e879d-7e87-4a10-ade5-e38470580729 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:39.202701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40162c-c377-4585-85c8-84ac2b6e99bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:39.203375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40162c-c377-4585-85c8-84ac2b6e99bf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.203874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40162c-c377-4585-85c8-84ac2b6e99bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.204309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40162c-c377-4585-85c8-84ac2b6e99bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.205062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40162c-c377-4585-85c8-84ac2b6e99bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:39.206738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40162c-c377-4585-85c8-84ac2b6e99bf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:39.220180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1048/2109] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:39.224260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:39.240624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f465aa-a129-4058-9662-b20f7530ab16 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:39.247875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:39.252979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.252979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.252979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] PATH_INFO: `/v3/projects/6940c4980bd247c986a305a72a9d1434/users/0d9c367e90704768900cf144a1639c27/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.271148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6940c4980bd247c986a305a72a9d1434, user_id=0d9c367e90704768900cf144a1639c27, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:39.275027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:39.493048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1062/2110] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:39 2022] PUT /identity/v3/projects/6940c4980bd247c986a305a72a9d1434/users/0d9c367e90704768900cf144a1639c27/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:39.498184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.498506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.498780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.516942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:39.518152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:39.561701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:39.563763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:39.578797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1049/2111] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:39.590867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:39.592598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:39.641183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295ae13-98e7-4787-a46a-8c0c7525ba2b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:39.645778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:39.646656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.646944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.647216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] PATH_INFO: `/v3/projects/474cb9aae80f44a180a399240192a45d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.649130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474cb9aae80f44a180a399240192a45d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:39.650489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53c01-fa71-4ece-a9a7-9a54fb524d78 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:39.651241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:39.654250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45edc7f-313d-4b8c-98e4-ed1691976db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:39.654811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45edc7f-313d-4b8c-98e4-ed1691976db1 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.655100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45edc7f-313d-4b8c-98e4-ed1691976db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.655377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45edc7f-313d-4b8c-98e4-ed1691976db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.665235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45edc7f-313d-4b8c-98e4-ed1691976db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:39.666839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45edc7f-313d-4b8c-98e4-ed1691976db1 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:39.676842 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1050/2112] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:39:39.790164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474cb9aae80f44a180a399240192a45d', 'request_id': 'req-32e66ce2-62ce-4e5b-9689-a9ed30e90594'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:39.903584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474cb9aae80f44a180a399240192a45d', 'request_id': 'req-32e66ce2-62ce-4e5b-9689-a9ed30e90594'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:39.910440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474cb9aae80f44a180a399240192a45d', 'request_id': 'req-32e66ce2-62ce-4e5b-9689-a9ed30e90594'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:39.920793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] The token cache is being invalidate because project 474cb9aae80f44a180a399240192a45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:39.921079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:39.921734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32e66ce2-62ce-4e5b-9689-a9ed30e90594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:39.923314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1063/2113] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:39 2022] DELETE /identity/v3/projects/474cb9aae80f44a180a399240192a45d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:39.929433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:39.930521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:39.930863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:39.950115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:39.951428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:40.019631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1051/2114] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:40.028401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.028694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.029150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.048446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:40.049756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:40.058047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1064/2115] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:39:40.062450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:40.072861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e28ed-6b65-4401-8426-fa6fc1d92afd None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:40.078141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:40.078304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.078520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.078796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.079545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:40.079853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:40.081483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:40.094371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1052/2116] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:39:40.098306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:40.108159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3bf6f-4f48-42fa-bd93-0dd28222081a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:40.113444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:40.114099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.114405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.114683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.115433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:40.117368 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:40.375070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1065/2117] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:40 2022] POST /identity/v3/projects => generated 379 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:40.379640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:40.391104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778adb3-1252-4e7c-bbb9-cf3697965ee2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:40.476878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:40.477570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.477844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.478467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.479376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:40.481343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:40.624381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1053/2118] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:40 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:40.628354 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:40.639457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff9a6b-7864-4357-a19d-e553e95b3f74 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:40.644526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:40.645199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.645486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.645764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.646549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:40.648161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:40.662303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1066/2119] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:40.663578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:40.674464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530f581-ca66-4975-9ecd-b2b90ddd9cba admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:40.679172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be0c7b-d2dd-4147-bfab-22e1fc405f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:40.680800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be0c7b-d2dd-4147-bfab-22e1fc405f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.681084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be0c7b-d2dd-4147-bfab-22e1fc405f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.681367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be0c7b-d2dd-4147-bfab-22e1fc405f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.682114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be0c7b-d2dd-4147-bfab-22e1fc405f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:40.683788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be0c7b-d2dd-4147-bfab-22e1fc405f49 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:40.694474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1054/2120] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:40.699118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:40.709471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48b02-b4d4-4b31-89a2-62a82b2846fa admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:40.715065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:40.716199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.716530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.716816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] PATH_INFO: `/v3/projects/b90d64cde82e4d52a80e61bbcf81c2b5/users/ee609c02c88a4960b2c6267f39824f20/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.733265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90d64cde82e4d52a80e61bbcf81c2b5, user_id=ee609c02c88a4960b2c6267f39824f20, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:40.736433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:40.842112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1067/2121] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:40 2022] PUT /identity/v3/projects/b90d64cde82e4d52a80e61bbcf81c2b5/users/ee609c02c88a4960b2c6267f39824f20/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:40.854106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:40.854430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:40.854709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:40.885671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] MFA Rules not processed for user `ee609c02c88a4960b2c6267f39824f20`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:40.886961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:40.952736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1055/2122] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:40.957319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:41.023299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406a51-e69b-461d-b8c7-4474bf1f355b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:41.027982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:41.028740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.028897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.029201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.029891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:41.031863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:41.151493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1068/2123] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:40 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:41.155759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:41.182672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76536-83bf-4040-87d6-a9c42042718c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:41.256252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:41.256952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.257235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.257512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.259639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:41.261804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:41.394076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1056/2124] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:41 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:41.398151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:41.408955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86501a20-9731-47c6-9081-816e6dde9fcd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:41.413618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:41.414868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.415218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.415879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.422051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:41.422051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:41.430457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1069/2125] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:41.434551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:41.445045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d0e27-2ae5-433e-b423-e5bf38fbec1a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:41.450309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643475ea-6ce5-4cd6-b86f-0d3673c9ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:41.451046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643475ea-6ce5-4cd6-b86f-0d3673c9ebbb admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.452148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643475ea-6ce5-4cd6-b86f-0d3673c9ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.452148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643475ea-6ce5-4cd6-b86f-0d3673c9ebbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.452358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643475ea-6ce5-4cd6-b86f-0d3673c9ebbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:41.454167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643475ea-6ce5-4cd6-b86f-0d3673c9ebbb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:41.466123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1057/2126] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:41.471944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:41.497959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ceee6-9b54-4e52-8f71-88636e1566be admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:41.503467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:41.504696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.505254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.505824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] PATH_INFO: `/v3/projects/c46e3f53ed37490cb55ad0e02945bdef/users/cff68c578c4641eb98f99c9acb585a4b/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.522534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46e3f53ed37490cb55ad0e02945bdef, user_id=cff68c578c4641eb98f99c9acb585a4b, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:41.532883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:41.681371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1070/2127] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:41 2022] PUT /identity/v3/projects/c46e3f53ed37490cb55ad0e02945bdef/users/cff68c578c4641eb98f99c9acb585a4b/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:41.691666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.692832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.693371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.748419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] MFA Rules not processed for user `cff68c578c4641eb98f99c9acb585a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:41.750428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:41.869156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1058/2128] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:41.873759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:41.955399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be86a6-b5c9-4e24-959b-f6abd6447878 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:41.960416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:41.962187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:41.962187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:41.962438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:41.963228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:41.965091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:42.090850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1071/2129] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:41 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:42.095253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:42.113591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7077c-4417-43db-b2e2-2c43cca52a05 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:42.182718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:42.183399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:42.183682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:42.183996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:42.184749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:42.186800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:42.374710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1059/2130] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:42 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:42.375961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:42.392567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369160-bfcb-4b33-b5cc-92c637f09d37 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:42.405483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:42.406723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:42.407259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:42.407878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:42.409116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:42.411470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:42.425886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1072/2131] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:42.431014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:42.446176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fccf4e-173b-433f-be50-74e9ff6f788f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:42.459715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:42.459715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:42.459715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:42.459715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] PATH_INFO: `/v3/projects/9d2b691e7eb74e7dbcd7f36220918a5b/users/d64f495e35f4479b80c22e8773c688b1/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:42.484825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2b691e7eb74e7dbcd7f36220918a5b, user_id=d64f495e35f4479b80c22e8773c688b1, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:42.488285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:42.693427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1060/2132] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:42 2022] PUT /identity/v3/projects/9d2b691e7eb74e7dbcd7f36220918a5b/users/d64f495e35f4479b80c22e8773c688b1/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:42.697656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:42.708399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5642d8-62d8-4680-9ee5-d24287bff425 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:42.777498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e9695-da63-48be-8d41-aab21579a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:42.778169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9695-da63-48be-8d41-aab21579a246 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:42.778497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9695-da63-48be-8d41-aab21579a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:42.778775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9695-da63-48be-8d41-aab21579a246 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:42.779545 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e9695-da63-48be-8d41-aab21579a246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:42.781192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e9695-da63-48be-8d41-aab21579a246 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:42.792378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1073/2133] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:42.796548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:42.807562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b59f-7c67-41ea-b628-b911b34f4d9c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:42.812194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:42.813131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:42.813346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:42.813614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] PATH_INFO: `/v3/projects/9d2b691e7eb74e7dbcd7f36220918a5b/users/d64f495e35f4479b80c22e8773c688b1/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:42.815571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2b691e7eb74e7dbcd7f36220918a5b, user_id=d64f495e35f4479b80c22e8773c688b1, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:42.818195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:42.829342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1061/2134] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:42 2022] PUT /identity/v3/projects/9d2b691e7eb74e7dbcd7f36220918a5b/users/d64f495e35f4479b80c22e8773c688b1/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:42.841057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:42.841366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:42.841644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:42.869964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] MFA Rules not processed for user `d64f495e35f4479b80c22e8773c688b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:42.871281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:42.962597 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1074/2135] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:42.973442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:42.975392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:43.060708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ba77b-6c97-4844-89f3-c400a8706e9d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:43.064721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a985ffa-fba4-46a9-be45-2dbc35a40b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:43.065316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a985ffa-fba4-46a9-be45-2dbc35a40b35 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:43.065655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a985ffa-fba4-46a9-be45-2dbc35a40b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:43.065931 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a985ffa-fba4-46a9-be45-2dbc35a40b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:43.076935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a985ffa-fba4-46a9-be45-2dbc35a40b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:43.078413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a985ffa-fba4-46a9-be45-2dbc35a40b35 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:43.088788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1062/2136] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:43.282117 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:43.294424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeab502-409e-4dce-8dbc-bfb004ea47c8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:43.298318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:43.299045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:43.299344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:43.314425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:43.365093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:43.366639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:43.386408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1075/2137] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:46.999599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:47.000047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:47.000137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:47.049324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] MFA Rules not processed for user `0d9c367e90704768900cf144a1639c27`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:47.050637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:47.179433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:47.180365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1063/2138] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:47.181790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:47.268065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff8c36-ee58-4e1d-b2a5-1bf74aa36f42 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:47.277153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:47.278923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:47.279227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:47.279516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:47.280273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:47.282488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:47.424714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1076/2139] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:47 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:47.428929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:47.441026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a684e78-5f31-43cb-b364-806eea11a5fc None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:47.520836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:47.521533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:47.521811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:47.522085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:47.522830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:47.525566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:47.629526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1064/2140] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:47 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:47.633835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:47.644331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490040a-4bcf-4559-8ac7-5f59b94d5394 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:47.650568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:47.651825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:47.652101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:47.652371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:47.653121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:47.655003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:47.667869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1077/2141] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:47.672260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:47.686007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753afba-ac67-4b08-ae7d-4b393db10a4e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:47.692284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:47.693921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:47.694346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:47.694917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] PATH_INFO: `/v3/projects/16d9dd96d339474485d844ea48e08257/users/fc43a67776d84fc7adbf8c2ad741d577/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:47.717298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d9dd96d339474485d844ea48e08257, user_id=fc43a67776d84fc7adbf8c2ad741d577, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:47.720554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:47.829021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1065/2142] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:47 2022] PUT /identity/v3/projects/16d9dd96d339474485d844ea48e08257/users/fc43a67776d84fc7adbf8c2ad741d577/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:47.829532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:47.854691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a5b8-f075-4689-b7a1-b19a32fb9036 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:47.957487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:47.958470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:47.958926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:47.959348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:47.960832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:47.963632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:47.981338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1078/2143] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:47.990304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:48.010729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275bc99-92cc-40c8-8a74-996cf19b34f8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:48.015638 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6d227-f74a-4c6b-9009-c7c374530d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:48.016963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d227-f74a-4c6b-9009-c7c374530d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:48.017402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d227-f74a-4c6b-9009-c7c374530d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:48.017837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d227-f74a-4c6b-9009-c7c374530d1c admin admin] PATH_INFO: `/v3/projects/16d9dd96d339474485d844ea48e08257/users/fc43a67776d84fc7adbf8c2ad741d577/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:48.020020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6d227-f74a-4c6b-9009-c7c374530d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d9dd96d339474485d844ea48e08257, user_id=fc43a67776d84fc7adbf8c2ad741d577, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:48.022943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6d227-f74a-4c6b-9009-c7c374530d1c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:48.037788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1066/2144] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:47 2022] PUT /identity/v3/projects/16d9dd96d339474485d844ea48e08257/users/fc43a67776d84fc7adbf8c2ad741d577/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:48.948032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:48.959533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8886-17ee-4aa4-a2f4-bbfa421bc5af admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:49.040115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:49.041303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:49.041756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:49.042397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] PATH_INFO: `/v3/users/ee609c02c88a4960b2c6267f39824f20` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:49.044429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee609c02c88a4960b2c6267f39824f20)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:49.047613 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:49.361011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee609c02c88a4960b2c6267f39824f20'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:49.369756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee609c02c88a4960b2c6267f39824f20'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:49.371731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee609c02c88a4960b2c6267f39824f20'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:49.372569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee609c02c88a4960b2c6267f39824f20'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:49.390073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee609c02c88a4960b2c6267f39824f20'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:49.577997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1079/2145] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:48 2022] DELETE /identity/v3/users/ee609c02c88a4960b2c6267f39824f20 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:49.582511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:49.582990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:49.583129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:49.600653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:49.602703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:49.673108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1067/2146] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:49.688578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:49.690018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:49.794343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5af187-1630-471d-b706-44bc89ae66e4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:49.801061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:49.802644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:49.803157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:49.804144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:49.818425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:49.821388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:49.854323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1080/2147] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:50.579914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:50.584630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:50.614945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240fd9-f043-47f5-bd72-ae10d3f6a0e1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:50.643104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:50.644417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:50.644963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:50.645465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] PATH_INFO: `/v3/projects/b90d64cde82e4d52a80e61bbcf81c2b5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:50.649230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90d64cde82e4d52a80e61bbcf81c2b5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:50.651850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:50.851232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90d64cde82e4d52a80e61bbcf81c2b5', 'request_id': 'req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:50.943682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90d64cde82e4d52a80e61bbcf81c2b5', 'request_id': 'req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:50.950832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90d64cde82e4d52a80e61bbcf81c2b5', 'request_id': 'req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:50.964730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] The token cache is being invalidate because project b90d64cde82e4d52a80e61bbcf81c2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:50.964938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:50.965609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:50.967421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1068/2148] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:50 2022] DELETE /identity/v3/projects/b90d64cde82e4d52a80e61bbcf81c2b5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:50.971561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:50.991789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3a62-7693-4767-acfa-25b772279295 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:51.080280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:51.081912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:51.082428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:51.082890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] PATH_INFO: `/v3/users/cff68c578c4641eb98f99c9acb585a4b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:51.084677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff68c578c4641eb98f99c9acb585a4b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:51.087319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:51.490010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff68c578c4641eb98f99c9acb585a4b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:51.497665 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff68c578c4641eb98f99c9acb585a4b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:51.498660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff68c578c4641eb98f99c9acb585a4b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:51.499271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff68c578c4641eb98f99c9acb585a4b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:51.513681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff68c578c4641eb98f99c9acb585a4b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:51.631812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1081/2149] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:50 2022] DELETE /identity/v3/users/cff68c578c4641eb98f99c9acb585a4b => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:52.408449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:52.409977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:52.465046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceea64-7bf0-4e94-a22a-caf8fe9a48aa admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:52.564998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:52.566526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:52.570934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:52.570934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] PATH_INFO: `/v3/projects/c46e3f53ed37490cb55ad0e02945bdef` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:52.570934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46e3f53ed37490cb55ad0e02945bdef)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:52.570934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:52.702103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46e3f53ed37490cb55ad0e02945bdef', 'request_id': 'req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:52.795561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46e3f53ed37490cb55ad0e02945bdef', 'request_id': 'req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:52.811833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46e3f53ed37490cb55ad0e02945bdef', 'request_id': 'req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:52.820048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] The token cache is being invalidate because project c46e3f53ed37490cb55ad0e02945bdef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:52.820371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:52.821409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:52.823321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1069/2150] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:52 2022] DELETE /identity/v3/projects/c46e3f53ed37490cb55ad0e02945bdef => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:52.826918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:52.829033 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:52.843195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43b717-3213-4a07-becd-91a6cc34660d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:52.930422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:52.931957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:52.932273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:52.932530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] PATH_INFO: `/v3/users/d64f495e35f4479b80c22e8773c688b1` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:52.933939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64f495e35f4479b80c22e8773c688b1)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:52.935980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:53.387217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64f495e35f4479b80c22e8773c688b1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:53.397123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64f495e35f4479b80c22e8773c688b1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:53.398142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64f495e35f4479b80c22e8773c688b1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:53.399830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64f495e35f4479b80c22e8773c688b1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:53.425036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-6aefe801-6301-41de-a507-303a47c40f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64f495e35f4479b80c22e8773c688b1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:53.540864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1082/2151] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:52 2022] DELETE /identity/v3/users/d64f495e35f4479b80c22e8773c688b1 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:54.471814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:54.478570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:54.528030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95a83e-242f-4cd8-8f59-aa5fb39f7484 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:54.625495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbedb6-5dea-4eab-9009-0ec46571cf06 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:54.626052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbedb6-5dea-4eab-9009-0ec46571cf06 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:54.626421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbedb6-5dea-4eab-9009-0ec46571cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:54.648162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ddbbedb6-5dea-4eab-9009-0ec46571cf06 None None] MFA Rules not processed for user `b6431c85b6c74608aae42e0e856d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:54.650590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ddbbedb6-5dea-4eab-9009-0ec46571cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:54.654948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:54.655828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:54.656112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:54.656519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] PATH_INFO: `/v3/projects/9d2b691e7eb74e7dbcd7f36220918a5b` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:54.663093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2b691e7eb74e7dbcd7f36220918a5b)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:54.665139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:54.780028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1083/2152] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:54.838737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2b691e7eb74e7dbcd7f36220918a5b', 'request_id': 'req-153bf984-d904-4f3e-b58a-5e42472ce230'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:54.915563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2b691e7eb74e7dbcd7f36220918a5b', 'request_id': 'req-153bf984-d904-4f3e-b58a-5e42472ce230'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:54.923254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2b691e7eb74e7dbcd7f36220918a5b', 'request_id': 'req-153bf984-d904-4f3e-b58a-5e42472ce230'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:54.966055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] The token cache is being invalidate because project 9d2b691e7eb74e7dbcd7f36220918a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:39:54.966055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:54.967065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-153bf984-d904-4f3e-b58a-5e42472ce230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:39:54.974310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1070/2153] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:39:54 2022] DELETE /identity/v3/projects/9d2b691e7eb74e7dbcd7f36220918a5b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:54.981435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:54.982097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:54.983154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.025991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:55.029138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:55.208371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1084/2154] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:55.222527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:55.222527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:55.222527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.256590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:55.256590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:55.271271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1071/2155] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:55.277297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:55.293401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992b852-e071-4b90-95a4-dd46333536c6 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:55.317633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:55.318887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:55.320854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:55.321872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.323699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:39:55.324097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:55.326648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:55.342403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1085/2156] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:39:55.347559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:55.367070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77377d86-8fd9-4005-928e-fb9f0b378aaf None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:55.378369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:55.381583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:55.382019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:55.382609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.383773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:55.388536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:55.544769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1072/2157] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:55 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:39:55.548289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:55.559482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41b31e-85ae-4eeb-83ea-333f19d1976b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:55.735060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:55.736532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:55.737025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:55.737477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.738413 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:55.741828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:55.870455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1086/2158] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:55 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:55.871207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:55.884779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878671cb-bafa-4763-a7ab-90595925d867 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:55.892823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:55.893760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:55.894243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:55.894673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.895755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:55.897763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:55.915404 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1073/2159] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:55.916631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:55.929360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f19066-75a8-4a89-85ec-c9fbdfb27535 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:55.954756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bbbe5-30f8-49bd-a075-67e7011f5dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:55.957775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbbe5-30f8-49bd-a075-67e7011f5dee admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:55.958290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbbe5-30f8-49bd-a075-67e7011f5dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:55.958839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bbbe5-30f8-49bd-a075-67e7011f5dee admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:55.962746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bbbe5-30f8-49bd-a075-67e7011f5dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:55.968515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bbbe5-30f8-49bd-a075-67e7011f5dee admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:56.018379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1087/2160] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:56.022628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:56.071427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce961453-ae1b-462f-9042-23b92593c5a4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:56.094782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:56.107375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:56.107658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:56.107945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] PATH_INFO: `/v3/projects/e672d49419cf42f8b9d7744752f3b7c4/users/a1abeba46ac642c2a69886653d60c943/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:56.159207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e672d49419cf42f8b9d7744752f3b7c4, user_id=a1abeba46ac642c2a69886653d60c943, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:56.163630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:56.369137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1074/2161] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:56 2022] PUT /identity/v3/projects/e672d49419cf42f8b9d7744752f3b7c4/users/a1abeba46ac642c2a69886653d60c943/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:39:56.371941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:56.372343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:56.372723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:56.432045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] MFA Rules not processed for user `a1abeba46ac642c2a69886653d60c943`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:56.433602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:56.573218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1088/2162] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:56.578184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:56.728854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb085427-c874-4700-9723-415c3243ae05 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:56.741742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5160843-d031-423d-9254-fe2601642812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:56.746373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160843-d031-423d-9254-fe2601642812 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:56.746373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160843-d031-423d-9254-fe2601642812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:56.746373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160843-d031-423d-9254-fe2601642812 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:56.746373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5160843-d031-423d-9254-fe2601642812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:56.750927 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5160843-d031-423d-9254-fe2601642812 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:56.938437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1075/2163] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:39:56 2022] POST /identity/v3/projects => generated 365 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:56.938561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:56.951081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a49e-1a76-4b14-aaff-4fec6b552b75 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.033886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.034632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.034989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.035336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.036283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.038601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.053990 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.054562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.055107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.088565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] MFA Rules not processed for user `fc43a67776d84fc7adbf8c2ad741d577`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:57.089657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:57.165765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1076/2164] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:57.175028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:57.176452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:57.207677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1089/2165] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:39:56 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:39:57.217060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:57.228111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ec201-f6ca-4059-82b6-25e8158480a8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.233446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.234497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.234787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.235121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.235891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.237604 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.253361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1090/2166] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:39:57.254777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:57.266617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ec1d6-e3fc-4c45-af38-f00723bab2b4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.271450 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cd3cb-c11e-4434-9707-e80680f10b26 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.272041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.273081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.273323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.273605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] PATH_INFO: `/v3/projects/0529cdd61854467abd588972073068b9/users/02ccf8e167ff47968c6437f597c31310/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.279700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.280319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.280673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.281021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.283582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:57.293103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0529cdd61854467abd588972073068b9, user_id=02ccf8e167ff47968c6437f597c31310, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.297051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.350918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.352731 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.362597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1077/2167] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:39:57.424918 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1091/2168] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:57 2022] PUT /identity/v3/projects/0529cdd61854467abd588972073068b9/users/02ccf8e167ff47968c6437f597c31310/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:57.429197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:57.440774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ff836-4c75-48c3-8c34-f13a0a312280 service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.503112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2fc2-079f-42d0-b3e6-604788a1bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.503840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2fc2-079f-42d0-b3e6-604788a1bf79 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.504369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2fc2-079f-42d0-b3e6-604788a1bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.504840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2fc2-079f-42d0-b3e6-604788a1bf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.505632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2fc2-079f-42d0-b3e6-604788a1bf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.508554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2fc2-079f-42d0-b3e6-604788a1bf79 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.522100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1078/2169] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:39:57.526046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:57.538122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a00e3-2420-4c7f-83d4-f51b32801dbf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.544444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.545283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.545579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.545920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] PATH_INFO: `/v3/projects/0529cdd61854467abd588972073068b9/users/02ccf8e167ff47968c6437f597c31310/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.548485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0529cdd61854467abd588972073068b9, user_id=02ccf8e167ff47968c6437f597c31310, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.551468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.564468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1092/2170] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:39:57 2022] PUT /identity/v3/projects/0529cdd61854467abd588972073068b9/users/02ccf8e167ff47968c6437f597c31310/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:39:57.576487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.576804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.577877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.613885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] MFA Rules not processed for user `02ccf8e167ff47968c6437f597c31310`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:39:57.614920 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:57.702385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1079/2171] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:39:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:39:57.715671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:57.717913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:57.822512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a914a9-d37c-402a-922b-e2677ee44cc3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:57.824770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:57.825555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:57.825902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:57.826292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:57.838744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:57.840236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:57.870606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1093/2172] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:58.310888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:58.327298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3260f7-e0c7-4b62-a2f2-c0986f6de64e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:58.337892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30596625-1aed-4511-b6c1-0fbf78f77c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:58.340605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30596625-1aed-4511-b6c1-0fbf78f77c90 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:58.341089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30596625-1aed-4511-b6c1-0fbf78f77c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:58.341848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30596625-1aed-4511-b6c1-0fbf78f77c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:58.463386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30596625-1aed-4511-b6c1-0fbf78f77c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:58.467187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30596625-1aed-4511-b6c1-0fbf78f77c90 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:39:58.492337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1080/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:39:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:39:59.339652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:39:59.342794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:39:59.464758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62808-f143-4311-80db-56446574d159 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:39:59.474726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:39:59.475805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:39:59.476432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:39:59.477738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] PATH_INFO: `/v3/users/9f7f8c343f234ab8a0a39507ce81b656` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:39:59.479263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7f8c343f234ab8a0a39507ce81b656)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:39:59.481531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:00.189836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7f8c343f234ab8a0a39507ce81b656'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:00.196747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7f8c343f234ab8a0a39507ce81b656'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:00.197840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7f8c343f234ab8a0a39507ce81b656'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:00.198663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7f8c343f234ab8a0a39507ce81b656'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:00.215886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7f8c343f234ab8a0a39507ce81b656'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:00.543261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1094/2174] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:39:59 2022] DELETE /identity/v3/users/9f7f8c343f234ab8a0a39507ce81b656 => generated 0 bytes in 1202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:00.544196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbd54-291e-4c24-bbec-6083cb4effa3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:00.544588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbd54-291e-4c24-bbec-6083cb4effa3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:00.544752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcbd54-291e-4c24-bbec-6083cb4effa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:00.564121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c7dcbd54-291e-4c24-bbec-6083cb4effa3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:00.566335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c7dcbd54-291e-4c24-bbec-6083cb4effa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:00.702710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1081/2175] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:00.767433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:00.769002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:00.967752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20cb9d-c6be-435f-aa09-8172e57458dd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:00.979935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:00.980925 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:00.981210 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:00.981513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:00.999722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:01.002206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:01.044777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1095/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:01.516542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:01.516833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:01.517311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:01.570087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:01.572269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:01.661742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1082/2177] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:40:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:01.678809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:01.680662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:01.838509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:01.840121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:01.852578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a6e36-9918-42b8-8109-156b30614583 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:01.856697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20985427-91f7-4706-b74d-91ec934665c1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:01.862464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:01.863611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:01.864224 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:01.864771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] PATH_INFO: `/v3/users/cd5ba57a44d74469ae804dcdafb2f17d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:01.866645 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5ba57a44d74469ae804dcdafb2f17d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:01.870860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:01.871009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:01.871756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:01.872112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:01.872456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:01.895650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:01.901744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:01.942461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1096/2178] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:40:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:40:02.198549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5ba57a44d74469ae804dcdafb2f17d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:02.230926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5ba57a44d74469ae804dcdafb2f17d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:02.232474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5ba57a44d74469ae804dcdafb2f17d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:02.252520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5ba57a44d74469ae804dcdafb2f17d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:02.374018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:02.380025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:02.401661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5ba57a44d74469ae804dcdafb2f17d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:02.412176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1083/2179] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:01 2022] DELETE /identity/v3/users/cd5ba57a44d74469ae804dcdafb2f17d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:02.429279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067075-88f7-4071-a0a1-b7ddfad950b5 service swift] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:02.679496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:02.681218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:02.681579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:02.681929 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] PATH_INFO: `/v3/projects/6b463944c6064c508255efc9197df1ec` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:02.684003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b463944c6064c508255efc9197df1ec)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:02.688099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:02.881912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b463944c6064c508255efc9197df1ec', 'request_id': 'req-13d844bc-8dc1-46c9-aca9-a116da712069'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.030301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b463944c6064c508255efc9197df1ec', 'request_id': 'req-13d844bc-8dc1-46c9-aca9-a116da712069'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.039893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b463944c6064c508255efc9197df1ec', 'request_id': 'req-13d844bc-8dc1-46c9-aca9-a116da712069'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.069790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] The token cache is being invalidate because project 6b463944c6064c508255efc9197df1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:03.070994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.072743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.086719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1097/2180] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:02 2022] DELETE /identity/v3/projects/6b463944c6064c508255efc9197df1ec => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:40:03.150148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:03.153014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:03.189925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c88c-b59a-4cea-bcad-7f2503c4c777 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:03.362337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:03.364873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:03.365391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:03.365885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] PATH_INFO: `/v3/projects/dff2384ab41246569dfd6041c018af6c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:03.367584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff2384ab41246569dfd6041c018af6c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:03.369893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:03.569208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff2384ab41246569dfd6041c018af6c', 'request_id': 'req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.715511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff2384ab41246569dfd6041c018af6c', 'request_id': 'req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.724472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff2384ab41246569dfd6041c018af6c', 'request_id': 'req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.742238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] The token cache is being invalidate because project dff2384ab41246569dfd6041c018af6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:03.742641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.743630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8063a9dd-752b-4fa9-8c28-20a2bc2ee283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:03.746539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1084/2181] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:03 2022] DELETE /identity/v3/projects/dff2384ab41246569dfd6041c018af6c => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:03.751087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:03.753844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:03.812979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d844bc-8dc1-46c9-aca9-a116da712069 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:03.951025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:03.953324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:03.954984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:03.955813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] PATH_INFO: `/v3/users/9e320fc242184b9295cdc8bee62a96b7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:03.959539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e320fc242184b9295cdc8bee62a96b7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:03.962578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:04.324263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e320fc242184b9295cdc8bee62a96b7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:04.343501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e320fc242184b9295cdc8bee62a96b7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:04.346046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e320fc242184b9295cdc8bee62a96b7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:04.347990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e320fc242184b9295cdc8bee62a96b7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:04.376346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e320fc242184b9295cdc8bee62a96b7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:04.553196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1098/2182] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:03 2022] DELETE /identity/v3/users/9e320fc242184b9295cdc8bee62a96b7 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:05.072567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab785-9311-4916-b230-5086c3ddc1ea None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:05.073345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab785-9311-4916-b230-5086c3ddc1ea None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:05.073727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ab785-9311-4916-b230-5086c3ddc1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:05.097268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0a2ab785-9311-4916-b230-5086c3ddc1ea None None] MFA Rules not processed for user `0d9c367e90704768900cf144a1639c27`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:05.098495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0a2ab785-9311-4916-b230-5086c3ddc1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:05.152176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:05.153654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:05.182128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1085/2183] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:05.268057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42722c-30d7-4532-a942-5acab5e0a9d7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:05.278423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:05.278423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:05.278423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:05.278423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] PATH_INFO: `/v3/projects/641c2aa6c9b9462a9b09db1c18c96268` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:05.282343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=641c2aa6c9b9462a9b09db1c18c96268)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:05.284379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:05.520709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641c2aa6c9b9462a9b09db1c18c96268', 'request_id': 'req-14624d7e-0938-414c-a342-0fad2b64a8eb'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:05.635744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641c2aa6c9b9462a9b09db1c18c96268', 'request_id': 'req-14624d7e-0938-414c-a342-0fad2b64a8eb'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:05.644190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641c2aa6c9b9462a9b09db1c18c96268', 'request_id': 'req-14624d7e-0938-414c-a342-0fad2b64a8eb'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:05.657248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] The token cache is being invalidate because project 641c2aa6c9b9462a9b09db1c18c96268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:05.657834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:05.659009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-14624d7e-0938-414c-a342-0fad2b64a8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:05.662276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1099/2184] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:05 2022] DELETE /identity/v3/projects/641c2aa6c9b9462a9b09db1c18c96268 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:05.669346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:05.669794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:05.670146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:05.708937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:05.710489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:05.822303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1086/2185] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:05.832054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:05.832733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:05.833249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:05.857860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:05.859832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:05.869747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1100/2186] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:05.874195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:05.887964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daa3a3-6e65-43e3-bf61-ddb73cfb6798 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:05.894542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:05.905613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:05.905613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:05.905613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:05.905613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:40:05.905613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:05.905613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:05.915987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1087/2187] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:40:05.920860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:05.932320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a359d9-780c-4f2e-b2d3-97a7539a9af0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:05.938272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:05.938272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:05.938962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:05.938962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:05.939426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:05.941521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:06.108656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1101/2188] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:05 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:06.113469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:06.135287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089e402-9846-499b-b0d6-cd1a1fab0605 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:06.285690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:06.286984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:06.287547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:06.288043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:06.289170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:06.291685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:06.471806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1088/2189] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:06 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:06.480963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:06.500750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f02b1-6635-4813-b08b-ac058d95bfac admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:06.524106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:06.524106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:06.524106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:06.524106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:06.524908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:06.524908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:06.540312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1102/2190] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:06.543165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:06.560430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb402-b09c-4f9d-b911-9dc9954f38d4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:06.567505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4569169-bb77-4395-8aac-641632e0c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:06.568622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4569169-bb77-4395-8aac-641632e0c216 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:06.569066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4569169-bb77-4395-8aac-641632e0c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:06.570129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4569169-bb77-4395-8aac-641632e0c216 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:06.571958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4569169-bb77-4395-8aac-641632e0c216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:06.574727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4569169-bb77-4395-8aac-641632e0c216 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:06.594430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1089/2191] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:06.595486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:06.608651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d28b1-6825-4bd3-a045-8a4116a6be4e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:06.614511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:06.615417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:06.615692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:06.616108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] PATH_INFO: `/v3/projects/d8fe3cb72f8a4af49fa0299aa68c0097/users/0e7f8a7304894b79b501f2897c76322b/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:06.643387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fe3cb72f8a4af49fa0299aa68c0097, user_id=0e7f8a7304894b79b501f2897c76322b, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:06.648061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:06.803375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1103/2192] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:06 2022] PUT /identity/v3/projects/d8fe3cb72f8a4af49fa0299aa68c0097/users/0e7f8a7304894b79b501f2897c76322b/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:06.810552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:06.810944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:06.811257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:06.901235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] MFA Rules not processed for user `0e7f8a7304894b79b501f2897c76322b`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:06.902736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:07.027732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1090/2193] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:07.041785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:07.045091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:07.138752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28715357-8713-432e-8833-d87a764d8913 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:07.143819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e503912-d417-4d94-8b00-a2a335e3e64c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:07.144479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503912-d417-4d94-8b00-a2a335e3e64c service glance] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:07.144757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503912-d417-4d94-8b00-a2a335e3e64c service glance] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:07.145250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503912-d417-4d94-8b00-a2a335e3e64c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:07.157264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e503912-d417-4d94-8b00-a2a335e3e64c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:07.158779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e503912-d417-4d94-8b00-a2a335e3e64c service glance] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:07.176101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1104/2194] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:09.692120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:09.693744 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:09.850583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a011dc4-d914-4046-b771-c7003a922ec0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:09.857416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:09.858705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:09.859829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:09.860363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] PATH_INFO: `/v3/users/a1abeba46ac642c2a69886653d60c943` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:09.862244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1abeba46ac642c2a69886653d60c943)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:09.865173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:10.238001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1abeba46ac642c2a69886653d60c943'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:10.269113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1abeba46ac642c2a69886653d60c943'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:10.270017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1abeba46ac642c2a69886653d60c943'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:10.279027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1abeba46ac642c2a69886653d60c943'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:10.642394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1abeba46ac642c2a69886653d60c943'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:10.651508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1091/2195] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:09 2022] DELETE /identity/v3/users/a1abeba46ac642c2a69886653d60c943 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:10.662372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:10.662372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:10.662372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:10.682272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:10.684207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:10.779283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1105/2196] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:10.795239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:10.799887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:10.934129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c94740-9de7-488d-a185-f2f935770c4c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:10.938443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:10.939446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:10.939730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:10.940049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:10.954598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:10.956145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:10.969901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1092/2197] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:12.134273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:12.135878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:12.150300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fe9cc-a79f-4f17-a5e8-e44bcf311cd4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:12.156030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:12.156961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:12.157249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:12.157522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] PATH_INFO: `/v3/projects/e672d49419cf42f8b9d7744752f3b7c4` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:12.158795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e672d49419cf42f8b9d7744752f3b7c4)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:12.160988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:12.419532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e672d49419cf42f8b9d7744752f3b7c4', 'request_id': 'req-ba4e38af-f360-4648-8def-4388e1d8cf26'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:12.612770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e672d49419cf42f8b9d7744752f3b7c4', 'request_id': 'req-ba4e38af-f360-4648-8def-4388e1d8cf26'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:12.626574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e672d49419cf42f8b9d7744752f3b7c4', 'request_id': 'req-ba4e38af-f360-4648-8def-4388e1d8cf26'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:12.643816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] The token cache is being invalidate because project e672d49419cf42f8b9d7744752f3b7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:12.644103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:12.644792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:12.646641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1106/2198] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:12 2022] DELETE /identity/v3/projects/e672d49419cf42f8b9d7744752f3b7c4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:12.651539 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:12.668456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb206c-5daf-4e9a-b39a-5bc8c7fb2273 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:12.743979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:12.745241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:12.745978 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:12.746583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] PATH_INFO: `/v3/users/02ccf8e167ff47968c6437f597c31310` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:12.749147 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ccf8e167ff47968c6437f597c31310)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:12.751923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:13.047928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ccf8e167ff47968c6437f597c31310'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:13.084342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ccf8e167ff47968c6437f597c31310'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:13.085827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ccf8e167ff47968c6437f597c31310'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:13.096333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ccf8e167ff47968c6437f597c31310'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:13.225811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f143f840-eef4-42b3-9bfa-d8dbb009e0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ccf8e167ff47968c6437f597c31310'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:13.238473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1093/2199] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:12 2022] DELETE /identity/v3/users/02ccf8e167ff47968c6437f597c31310 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:13.850937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:13.853191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:13.871556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e38af-f360-4648-8def-4388e1d8cf26 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:14.026067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:14.027206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:14.027592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:14.027974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] PATH_INFO: `/v3/projects/0529cdd61854467abd588972073068b9` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:14.029766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0529cdd61854467abd588972073068b9)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:14.044677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:14.218640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0529cdd61854467abd588972073068b9', 'request_id': 'req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:14.336584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0529cdd61854467abd588972073068b9', 'request_id': 'req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:14.345188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0529cdd61854467abd588972073068b9', 'request_id': 'req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:14.361979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] The token cache is being invalidate because project 0529cdd61854467abd588972073068b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:14.362316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:14.363027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c9f8e709-4377-49a9-8ab5-0f6ecd6a5854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:14.370610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1107/2200] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:13 2022] DELETE /identity/v3/projects/0529cdd61854467abd588972073068b9 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:40:14.371714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:14.372208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:14.372324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:14.393071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:14.394463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:14.476072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1094/2201] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:40:14.486716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:14.486716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:14.486716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:14.532397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:14.536681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:14.562128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:14.573321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f107731-339a-4e88-ac69-6b4e1a206872 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:14.574054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1108/2202] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:14.585703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:14.587293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:14.587979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:14.588462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:14.589304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:40:14.589689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:14.591449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:14.605363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1095/2203] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:40:14.612609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:14.623074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225eac8-b27b-44ec-af3e-d2bde42d129d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:14.631043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:14.642264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:14.642658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:14.665345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:14.665345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:14.672423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:14.976567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1109/2204] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:14 2022] POST /identity/v3/projects => generated 383 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:14.983454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:15.001395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8f36-8ef7-4c30-ba5e-c6e39a160637 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:15.136957 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:15.138058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:15.138517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:15.138977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:15.140113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:15.143675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:15.287169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1096/2205] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:14 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:15.288465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:15.301326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044739f-8c79-4c6f-8302-88d3b9aa7067 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:15.328227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:15.335610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:15.338236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:15.339060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:15.340983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:15.344066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:15.361262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1110/2206] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:15.374787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:15.397502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280462c9-edcc-44ac-93c2-0b8055313524 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:15.410111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00086aed-5589-4ff9-8af9-8267e71ca685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:15.411687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00086aed-5589-4ff9-8af9-8267e71ca685 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:15.412356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00086aed-5589-4ff9-8af9-8267e71ca685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:15.413311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00086aed-5589-4ff9-8af9-8267e71ca685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:15.419666 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00086aed-5589-4ff9-8af9-8267e71ca685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:15.421964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00086aed-5589-4ff9-8af9-8267e71ca685 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:15.466829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1097/2207] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:40:15.474164 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:15.480575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7fc7-32f3-4687-bb4b-69c373119f02 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:15.491296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:15.493227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:15.493755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:15.494296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] PATH_INFO: `/v3/projects/52a1f3e236874c9c8c1ec8a82508f292/users/7ef7a2b0f2094b3091cae3be2de24a61/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:15.521601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f3e236874c9c8c1ec8a82508f292, user_id=7ef7a2b0f2094b3091cae3be2de24a61, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:15.525178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:15.666178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1111/2208] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:15 2022] PUT /identity/v3/projects/52a1f3e236874c9c8c1ec8a82508f292/users/7ef7a2b0f2094b3091cae3be2de24a61/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:15.676488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:15.687081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:15.687081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:15.719940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] MFA Rules not processed for user `7ef7a2b0f2094b3091cae3be2de24a61`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:15.721783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:15.896175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1098/2209] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:15.901622 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:16.005601 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c20af-5007-4459-98d4-3941d5236a3b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:16.016874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:16.017555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:16.017833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:16.018107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:16.018843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:16.020784 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:16.769556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1112/2210] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:15 2022] POST /identity/v3/projects => generated 383 bytes in 869 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:16.776392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:16.785163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cd1ec-c102-411e-be9c-a2897bc9f943 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:16.854814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:16.855198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:16.855973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:16.855973 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:16.857251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:16.859530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:17.055854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1099/2211] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:16 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:40:17.060660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:17.085059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c5d7-d4eb-4730-8b25-d7dfa9f996c8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:17.095543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:17.103122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:17.103122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:17.103122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:17.103122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:17.103122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:17.116898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1113/2212] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:17.122563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:17.146799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8a70d-85e6-4f04-bd20-968e524c2702 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:17.153241 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:17.154640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:17.155148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:17.155639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] PATH_INFO: `/v3/projects/34bd29299de84712a2a86088190b3a36/users/4d86205efec74436ab3d8392fd263b5a/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:17.197225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bd29299de84712a2a86088190b3a36, user_id=4d86205efec74436ab3d8392fd263b5a, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:17.202686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:17.368397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1100/2213] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:17 2022] PUT /identity/v3/projects/34bd29299de84712a2a86088190b3a36/users/4d86205efec74436ab3d8392fd263b5a/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:17.372470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:17.386144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf29e6-4770-4531-b7d4-21c39b71afb0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:17.521121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ac1e3-ba13-4908-b080-1a1e6851a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:17.521806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac1e3-ba13-4908-b080-1a1e6851a24f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:17.522091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac1e3-ba13-4908-b080-1a1e6851a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:17.522415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ac1e3-ba13-4908-b080-1a1e6851a24f admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:17.523183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac1e3-ba13-4908-b080-1a1e6851a24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:17.525585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ac1e3-ba13-4908-b080-1a1e6851a24f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:17.557694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1114/2214] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:17.561943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:17.575625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad8847-a5a5-475a-8faf-1ae49c6076b7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:17.587102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:17.590038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:17.590393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:17.590676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] PATH_INFO: `/v3/projects/34bd29299de84712a2a86088190b3a36/users/4d86205efec74436ab3d8392fd263b5a/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:17.593708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bd29299de84712a2a86088190b3a36, user_id=4d86205efec74436ab3d8392fd263b5a, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:17.596648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:17.620664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1101/2215] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:17 2022] PUT /identity/v3/projects/34bd29299de84712a2a86088190b3a36/users/4d86205efec74436ab3d8392fd263b5a/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:17.631701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:17.632290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:17.632759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:17.669934 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] MFA Rules not processed for user `4d86205efec74436ab3d8392fd263b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:17.671432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:17.794614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1115/2216] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:17.804430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:17.806510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:17.936403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf910770-2dd2-4a45-9cca-a5b17db5d086 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:17.940644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:17.941439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:17.941773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:17.942108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:17.955223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:17.956688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:17.968137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1102/2217] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:40:18.304049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:18.314760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c67cd-db22-4aea-b42a-f04e5ad6527f None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:18.318630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b380967-a4d1-4a1f-bd08-63a0fc362f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:18.319461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b380967-a4d1-4a1f-bd08-63a0fc362f1d service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:18.319902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b380967-a4d1-4a1f-bd08-63a0fc362f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:18.320381 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b380967-a4d1-4a1f-bd08-63a0fc362f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:18.381138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b380967-a4d1-4a1f-bd08-63a0fc362f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:18.382736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b380967-a4d1-4a1f-bd08-63a0fc362f1d service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:18.393517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1116/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:19.151733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:19.225574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cb55-bb5e-4ce4-aeae-56979e059023 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:19.230529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:19.232010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:19.232010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:19.232010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] PATH_INFO: `/v3/users/7ef7a2b0f2094b3091cae3be2de24a61` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:19.233209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef7a2b0f2094b3091cae3be2de24a61)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:19.235444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:19.569979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef7a2b0f2094b3091cae3be2de24a61'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:19.584662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef7a2b0f2094b3091cae3be2de24a61'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:19.585328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef7a2b0f2094b3091cae3be2de24a61'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:19.592448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef7a2b0f2094b3091cae3be2de24a61'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:19.716626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef7a2b0f2094b3091cae3be2de24a61'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:19.723138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1103/2219] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:19 2022] DELETE /identity/v3/users/7ef7a2b0f2094b3091cae3be2de24a61 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:19.731436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:19.731436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:19.731436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:19.749090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:19.750348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:19.815863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1117/2220] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:40:19.825648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:19.827221 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:19.893165 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082150-a0be-4a93-9c2c-59bb51b9d345 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:19.896829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:19.897471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:19.897753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:19.898029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:19.910082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:19.911685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:19.926331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1104/2221] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:20.602978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:20.604495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:20.627671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54cc60-b35b-48f1-b0ee-c43f1f6bf3a8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:20.633065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:20.634635 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:20.634984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:20.635328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] PATH_INFO: `/v3/projects/52a1f3e236874c9c8c1ec8a82508f292` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:20.636617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a1f3e236874c9c8c1ec8a82508f292)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:20.638637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:20.809501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a1f3e236874c9c8c1ec8a82508f292', 'request_id': 'req-99f3ec33-927f-44f3-ac34-1308bc266c46'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:20.927936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a1f3e236874c9c8c1ec8a82508f292', 'request_id': 'req-99f3ec33-927f-44f3-ac34-1308bc266c46'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:20.935708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a1f3e236874c9c8c1ec8a82508f292', 'request_id': 'req-99f3ec33-927f-44f3-ac34-1308bc266c46'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:20.949812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] The token cache is being invalidate because project 52a1f3e236874c9c8c1ec8a82508f292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:20.950101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:20.950943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:20.952533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1118/2222] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:20 2022] DELETE /identity/v3/projects/52a1f3e236874c9c8c1ec8a82508f292 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:20.956775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:20.967027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d205c-b0fa-4cb9-949f-7e8d6aa0acbd service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:21.024074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:21.024942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:21.025275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:21.025551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] PATH_INFO: `/v3/users/4d86205efec74436ab3d8392fd263b5a` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:21.026780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d86205efec74436ab3d8392fd263b5a)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:21.030070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:21.303953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d86205efec74436ab3d8392fd263b5a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:21.317953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d86205efec74436ab3d8392fd263b5a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:21.319285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d86205efec74436ab3d8392fd263b5a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:21.327925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d86205efec74436ab3d8392fd263b5a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:21.464845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a2c12eb6-bbbd-4654-8091-bdf7878b93f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d86205efec74436ab3d8392fd263b5a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:21.472126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1105/2223] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:20 2022] DELETE /identity/v3/users/4d86205efec74436ab3d8392fd263b5a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:21.994122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:21.995924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:22.011206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3ec33-927f-44f3-ac34-1308bc266c46 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:22.078101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:22.078994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:22.079276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:22.079558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] PATH_INFO: `/v3/projects/34bd29299de84712a2a86088190b3a36` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:22.080753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bd29299de84712a2a86088190b3a36)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:22.082706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:22.212736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bd29299de84712a2a86088190b3a36', 'request_id': 'req-55848202-26c6-4233-8fe5-433d990dd116'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:22.350678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bd29299de84712a2a86088190b3a36', 'request_id': 'req-55848202-26c6-4233-8fe5-433d990dd116'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:22.366561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bd29299de84712a2a86088190b3a36', 'request_id': 'req-55848202-26c6-4233-8fe5-433d990dd116'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:22.383894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] The token cache is being invalidate because project 34bd29299de84712a2a86088190b3a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:22.384790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:22.386180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-55848202-26c6-4233-8fe5-433d990dd116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:22.397180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1119/2224] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:21 2022] DELETE /identity/v3/projects/34bd29299de84712a2a86088190b3a36 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:22.402616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:22.403361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:22.403652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:22.425819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:22.428315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:22.530185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1106/2225] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:22.532102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:22.532426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:22.532698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:22.557004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:22.558592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:22.580700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1120/2226] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:22.581969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:22.597699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76221069-df9e-482b-8cac-7c0deb34a40d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:22.604680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:22.606400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:22.606861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:22.607860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:22.609222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:40:22.609687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:22.611910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:22.632451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1107/2227] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:40:22.634347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:22.652085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32948-787e-41ac-92ca-023a9c952b14 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:22.657780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:22.658676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:22.659035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:22.659383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:22.660337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:22.662569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:22.782456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1121/2228] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:22 2022] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:22.787288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:22.799806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861992c-17f7-4d06-a3c9-2d72abae7f39 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:22.883918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:22.884837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:22.885126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:22.885478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:22.886330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:22.888400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:23.034475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1108/2229] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:22 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:23.035886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:23.047148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5a9be-569f-4b78-bd3c-e816ca4db724 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:23.052552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:23.053338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:23.053616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:23.053903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:23.054796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:23.058092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:23.070443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1122/2230] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:40:23.075406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:23.086189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310261e3-fa55-494c-b8e7-a384bfe7d1d9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:23.091559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4412c-913d-48a8-92e1-fa928d3224a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:23.092182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4412c-913d-48a8-92e1-fa928d3224a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:23.092466 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4412c-913d-48a8-92e1-fa928d3224a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:23.092739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4412c-913d-48a8-92e1-fa928d3224a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:23.093479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4412c-913d-48a8-92e1-fa928d3224a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:23.095446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4412c-913d-48a8-92e1-fa928d3224a4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:23.112617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1109/2231] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:23.112828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:23.124563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91293007-0d6e-40b3-b86b-984f24501107 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:23.130298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:23.136369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:23.136369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:23.136369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] PATH_INFO: `/v3/projects/17b309636a604d0d92f178c149efa6c3/users/e1ef8500c4924191be1bff06ff104714/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:23.149027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b309636a604d0d92f178c149efa6c3, user_id=e1ef8500c4924191be1bff06ff104714, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:23.158104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:23.275596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1123/2232] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:23 2022] PUT /identity/v3/projects/17b309636a604d0d92f178c149efa6c3/users/e1ef8500c4924191be1bff06ff104714/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:23.278239 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64391-466c-4d92-980c-c692a5b8e6fc None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:23.278662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64391-466c-4d92-980c-c692a5b8e6fc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:23.279120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64391-466c-4d92-980c-c692a5b8e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:23.378363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8bc64391-466c-4d92-980c-c692a5b8e6fc None None] MFA Rules not processed for user `e1ef8500c4924191be1bff06ff104714`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:23.379524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8bc64391-466c-4d92-980c-c692a5b8e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:23.451976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1110/2233] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:23.464236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:23.465962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:23.527037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbfa48-d907-4908-8d61-342565403119 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:23.530837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4dcbc-988e-405b-bc63-6c1266987ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:23.531490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4dcbc-988e-405b-bc63-6c1266987ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:23.531776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4dcbc-988e-405b-bc63-6c1266987ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:23.532051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4dcbc-988e-405b-bc63-6c1266987ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:23.541910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4dcbc-988e-405b-bc63-6c1266987ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:23.544579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4dcbc-988e-405b-bc63-6c1266987ec9 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:23.554303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1124/2234] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:26.381369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d175-6ec5-499e-8874-ece8847cfdde None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:26.381967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d175-6ec5-499e-8874-ece8847cfdde None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:26.381967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d175-6ec5-499e-8874-ece8847cfdde None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:26.384430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1111/2235] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:40:26.391674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cc55-485c-4e57-b983-028f0c3c0fc2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:26.392235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cc55-485c-4e57-b983-028f0c3c0fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:26.392335 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cc55-485c-4e57-b983-028f0c3c0fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:26.467850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0384cc55-485c-4e57-b983-028f0c3c0fc2 None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:26.469010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0384cc55-485c-4e57-b983-028f0c3c0fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:26.560404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1125/2236] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:40:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:26.573936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d175-6ec5-499e-8874-ece8847cfdde None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:26.575677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-79f1d175-6ec5-499e-8874-ece8847cfdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:26.640022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d175-6ec5-499e-8874-ece8847cfdde None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:26.643784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972f9a-c43d-45f0-ba72-b42d3e3cfd00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:26.644492 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972f9a-c43d-45f0-ba72-b42d3e3cfd00 service glance] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:26.644773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972f9a-c43d-45f0-ba72-b42d3e3cfd00 service glance] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:26.645053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972f9a-c43d-45f0-ba72-b42d3e3cfd00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:26.659930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972f9a-c43d-45f0-ba72-b42d3e3cfd00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:26.661801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972f9a-c43d-45f0-ba72-b42d3e3cfd00 service glance] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:26.679689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1112/2237] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:26.981485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d60d9-292e-4707-865e-0c32d6e0409e None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:26.981683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d60d9-292e-4707-865e-0c32d6e0409e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:26.981959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d60d9-292e-4707-865e-0c32d6e0409e None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:26.983804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1126/2238] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 11:40:26.989266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:26.991351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:26.991351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:27.015611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:27.016811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:27.088135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1113/2239] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:40:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:40:27.100298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d60d9-292e-4707-865e-0c32d6e0409e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:27.102301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-672d60d9-292e-4707-865e-0c32d6e0409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:27.122108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d60d9-292e-4707-865e-0c32d6e0409e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:27.126029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:27.126718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:27.127007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:27.127287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:27.136416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:27.137908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:27.146050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1127/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:30.247804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:30.249366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:30.398692 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5fd87-945f-44ad-a6d4-99ad9068f7aa None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:30.403354 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:30.404145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:30.404527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:30.404967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:30.411804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:30.443012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:30.443012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384c195-f64e-48c9-9f49-321dadbed20a service placement] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:30.458351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1114/2241] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:33.240846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:33.319733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabd137-4ef6-422a-b0aa-e98766898019 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:33.325013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:33.325888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:33.326179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:33.326475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] PATH_INFO: `/v3/users/e1ef8500c4924191be1bff06ff104714` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:33.328120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ef8500c4924191be1bff06ff104714)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:33.330132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:33.600422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ef8500c4924191be1bff06ff104714'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:33.608832 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ef8500c4924191be1bff06ff104714'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:33.609752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ef8500c4924191be1bff06ff104714'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:33.610791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ef8500c4924191be1bff06ff104714'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:33.627513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ef8500c4924191be1bff06ff104714'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:33.780037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1128/2242] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:33 2022] DELETE /identity/v3/users/e1ef8500c4924191be1bff06ff104714 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:33.782705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57a514-ab30-4542-a254-ba08093ca079 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:33.783562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57a514-ab30-4542-a254-ba08093ca079 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:33.784463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57a514-ab30-4542-a254-ba08093ca079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:33.815670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7f57a514-ab30-4542-a254-ba08093ca079 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:33.818545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7f57a514-ab30-4542-a254-ba08093ca079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:33.917976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1115/2243] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:33.935138 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:33.937535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:34.020658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484df61-0314-4494-9417-70e0947541a2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:34.032334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:34.035733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:34.035733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:34.035733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:34.046599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:34.048344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:34.060578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1129/2244] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:34.800560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:34.802993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:34.802993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:34.826738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:34.828824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:34.928503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1116/2245] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:40:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:40:34.940699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:34.942392 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:34.965708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671d2e-71a7-4068-9ccc-27d437de6fc3 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:34.971158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:34.974927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:34.974927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:34.974927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] PATH_INFO: `/v3/projects/17b309636a604d0d92f178c149efa6c3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:34.975980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b309636a604d0d92f178c149efa6c3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:34.979801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:34.990291 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:34.992502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:35.138668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b309636a604d0d92f178c149efa6c3', 'request_id': 'req-97e933dc-74c1-4c7b-9dee-28053834e098'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:35.260195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008650a-f63c-467d-872a-c42b3ed9b3e2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:35.295011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b309636a604d0d92f178c149efa6c3', 'request_id': 'req-97e933dc-74c1-4c7b-9dee-28053834e098'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:35.303629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b309636a604d0d92f178c149efa6c3', 'request_id': 'req-97e933dc-74c1-4c7b-9dee-28053834e098'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:35.327697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] The token cache is being invalidate because project 17b309636a604d0d92f178c149efa6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:35.328051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:35.328991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:35.331281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1130/2246] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:34 2022] DELETE /identity/v3/projects/17b309636a604d0d92f178c149efa6c3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:35.374854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:35.375753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:35.376105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:35.376446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:35.380674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:35.516398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:35.518347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932edd8e-4147-477b-a0b0-1c5543d678f9 service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:35.528747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1117/2247] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 11:40:40.309009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:40.310481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:40.389771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e933dc-74c1-4c7b-9dee-28053834e098 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:40.389771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:40.389771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:40.389771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:40.390300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] PATH_INFO: `/v3/users/0e7f8a7304894b79b501f2897c76322b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:40.390705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7f8a7304894b79b501f2897c76322b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:40.392651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:40.768714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7f8a7304894b79b501f2897c76322b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:40.790111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7f8a7304894b79b501f2897c76322b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:40.790111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7f8a7304894b79b501f2897c76322b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:40.790111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7f8a7304894b79b501f2897c76322b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:40.793047 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7f8a7304894b79b501f2897c76322b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:41.031785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1131/2248] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:40 2022] DELETE /identity/v3/users/0e7f8a7304894b79b501f2897c76322b => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:41.036543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:41.037118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:41.037118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:41.080194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:41.080194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:41.127898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1118/2249] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:40:41.139590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:41.141755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:41.220388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f727c19-57fb-4d26-b4e1-77d731a80ef8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:41.224403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878995-f616-4bf8-873a-360ce781e6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:41.225155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878995-f616-4bf8-873a-360ce781e6fb service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:41.225504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878995-f616-4bf8-873a-360ce781e6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:41.225844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878995-f616-4bf8-873a-360ce781e6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:41.237441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46878995-f616-4bf8-873a-360ce781e6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:41.239143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46878995-f616-4bf8-873a-360ce781e6fb service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:41.259398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1132/2250] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:41.845536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:41.846929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:41.876040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e35fa-36c0-436a-a156-49e1b82b4bda None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:41.881783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:41.883135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:41.883660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:41.884152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] PATH_INFO: `/v3/projects/d8fe3cb72f8a4af49fa0299aa68c0097` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:41.886325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fe3cb72f8a4af49fa0299aa68c0097)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:41.889202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:42.023860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fe3cb72f8a4af49fa0299aa68c0097', 'request_id': 'req-39f74c81-6e66-4424-a3d6-0dc48c147a23'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:42.117184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fe3cb72f8a4af49fa0299aa68c0097', 'request_id': 'req-39f74c81-6e66-4424-a3d6-0dc48c147a23'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:42.128068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fe3cb72f8a4af49fa0299aa68c0097', 'request_id': 'req-39f74c81-6e66-4424-a3d6-0dc48c147a23'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:42.137809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] The token cache is being invalidate because project d8fe3cb72f8a4af49fa0299aa68c0097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:42.138101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:42.138852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-39f74c81-6e66-4424-a3d6-0dc48c147a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:42.140389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1119/2251] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:41 2022] DELETE /identity/v3/projects/d8fe3cb72f8a4af49fa0299aa68c0097 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:42.146113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:42.146688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:42.146688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:42.166559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:42.167778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:42.238187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1133/2252] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:42.250729 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:42.251008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:42.251288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:42.271469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:42.272693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:42.283646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1120/2253] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:42.287733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:42.298512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a36da-bf57-4211-82af-a9d44429fb9b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:42.307366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:42.308790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:42.309243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:42.309688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:42.311176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:40:42.311676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:42.314530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:42.333952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1134/2254] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:40:42.344017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:42.354199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678591c6-58cb-42d3-92b0-e0b06fe6af48 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:42.359763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:42.360462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:42.361007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:42.361362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:42.362143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:42.364289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:42.787171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1121/2255] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:42 2022] POST /identity/v3/projects => generated 371 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:42.792170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:42.817748 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc50d-c1c9-4c37-af47-fc4ed214208c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:42.912430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:42.913104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:42.913385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:42.913656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:42.914393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:42.916500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:43.146508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1135/2256] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:42 2022] POST /identity/v3/users => generated 286 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:43.147717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:43.161938 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a2c8-f23f-4933-94b0-08549cf9f94e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:43.167344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:43.168020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:43.168297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:43.168571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:43.169308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:43.170998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:43.185174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1122/2257] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:43.186355 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:43.197922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2723b48-c0b0-4971-91d7-22c337f28ba3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:43.208408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8d888-4296-4a8c-9119-cfcca85ea646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:43.209195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8d888-4296-4a8c-9119-cfcca85ea646 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:43.209667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8d888-4296-4a8c-9119-cfcca85ea646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:43.210065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8d888-4296-4a8c-9119-cfcca85ea646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:43.211117 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8d888-4296-4a8c-9119-cfcca85ea646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:43.213768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8d888-4296-4a8c-9119-cfcca85ea646 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:43.225180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1136/2258] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:43.237134 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:43.263429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fb34-148b-4027-bd19-cc71a2a68fd0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:43.268282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:43.269240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:43.269468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:43.270438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] PATH_INFO: `/v3/projects/b4729d5fc6854e13b331e0ca69db54fd/users/e5d1abe7ad94433b8a6aec49af55c4fe/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:43.289311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4729d5fc6854e13b331e0ca69db54fd, user_id=e5d1abe7ad94433b8a6aec49af55c4fe, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:43.296316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:43.471997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1123/2259] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:43 2022] PUT /identity/v3/projects/b4729d5fc6854e13b331e0ca69db54fd/users/e5d1abe7ad94433b8a6aec49af55c4fe/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:43.482909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:43.483314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:43.483664 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:43.515183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] MFA Rules not processed for user `e5d1abe7ad94433b8a6aec49af55c4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:43.519122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:43.605522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1137/2260] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:43.617616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:43.621040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:43.730040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0757b1-03c0-4ba0-a8bf-bcd33bf0340e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:43.733783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:43.734451 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:43.734761 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:43.735033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:43.743942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:43.745368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:43.754690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1124/2261] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:52.526862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:52.528103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:52.622120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862497eb-5c8f-41a2-9c8c-5dee1e0871d1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:52.628358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:52.629690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:52.629978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:52.630293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] PATH_INFO: `/v3/users/14216d42be0e4e1690f9a77a09e25967` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:52.631634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14216d42be0e4e1690f9a77a09e25967)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:52.633611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:52.864144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14216d42be0e4e1690f9a77a09e25967'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:52.874411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14216d42be0e4e1690f9a77a09e25967'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:52.874411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14216d42be0e4e1690f9a77a09e25967'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:52.874411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14216d42be0e4e1690f9a77a09e25967'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:52.893187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14216d42be0e4e1690f9a77a09e25967'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:52.900647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:52.902255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:52.969301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3ba3d-ed2b-4af3-b400-3cfff1569821 service glance] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:52.969722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1138/2262] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:40:52 2022] DELETE /identity/v3/users/14216d42be0e4e1690f9a77a09e25967 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:53.028229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:53.028810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:53.029094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:53.029367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:53.031402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:53.110207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:53.111999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa0866-2a03-46c7-b12c-85d201ba5661 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:53.122810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1125/2263] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:40:53.315787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:53.322991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:53.428024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1b6f0-50a5-4cda-aa89-9af1a03cd10c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:53.434410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:53.435353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:53.435632 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:53.435909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] PATH_INFO: `/v3/projects/a77ddb5f1ea14e54be79c194a288b5a7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:53.437165 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77ddb5f1ea14e54be79c194a288b5a7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:53.439217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:53.577295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77ddb5f1ea14e54be79c194a288b5a7', 'request_id': 'req-b11e257c-45dd-4144-8d38-95e48e0480c5'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:53.689169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77ddb5f1ea14e54be79c194a288b5a7', 'request_id': 'req-b11e257c-45dd-4144-8d38-95e48e0480c5'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:53.696242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77ddb5f1ea14e54be79c194a288b5a7', 'request_id': 'req-b11e257c-45dd-4144-8d38-95e48e0480c5'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:53.714778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] The token cache is being invalidate because project a77ddb5f1ea14e54be79c194a288b5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:40:53.715228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:53.715890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b11e257c-45dd-4144-8d38-95e48e0480c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:40:53.717681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1139/2264] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:40:53 2022] DELETE /identity/v3/projects/a77ddb5f1ea14e54be79c194a288b5a7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:53.724428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:53.724728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:53.724999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:53.744407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:53.745802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:53.816519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1126/2265] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:53.825296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:53.825589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:53.825871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:53.845079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:53.846427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:53.858891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1140/2266] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:53.860078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:53.875118 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec634-a384-49e8-b29f-93672c4631d1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:53.884685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:53.884685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:53.884685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:53.884685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:53.885220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:40:53.885220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:53.885220 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:53.903342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1127/2267] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:40:53.908237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:53.919336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950750-f138-4eeb-bb58-18952424aed5 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:53.942111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:53.942811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:53.943099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:53.943375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:53.944089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:53.946043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:54.059221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1141/2268] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:53 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:54.060569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:54.071111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00149f7-b861-4778-b635-badd3a72536b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:54.135799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:54.136472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:54.136806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:54.137086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:54.137858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:54.139831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:54.256429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1128/2269] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:54 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:54.260783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:54.274321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd53704-f581-4a56-8c9b-d34e36cb0f24 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:54.281577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:54.282289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:54.282571 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:54.284440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:54.284440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:54.285188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:54.298418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1142/2270] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:54.319052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:54.329841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d392a-1792-411e-ae3e-6bd4e89fc4fc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:54.335621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fd558-f46d-4b9b-a6fc-126fcdba87d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:54.336288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fd558-f46d-4b9b-a6fc-126fcdba87d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:54.336567 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fd558-f46d-4b9b-a6fc-126fcdba87d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:54.336835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fd558-f46d-4b9b-a6fc-126fcdba87d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:54.338339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fd558-f46d-4b9b-a6fc-126fcdba87d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:54.340359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49fd558-f46d-4b9b-a6fc-126fcdba87d3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:54.351919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1129/2271] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:40:54.358804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:54.369671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa115776-a0f5-495e-af54-0342d47f7dbf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:54.374141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:54.375046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:54.375352 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:54.375621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] PATH_INFO: `/v3/projects/2524fc1d3ee2482a962ecf3b186dc3cf/users/52a47c8e96214459bd6cf90b1b40a56d/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:54.406569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2524fc1d3ee2482a962ecf3b186dc3cf, user_id=52a47c8e96214459bd6cf90b1b40a56d, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:54.410239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:54.565241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1143/2272] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:54 2022] PUT /identity/v3/projects/2524fc1d3ee2482a962ecf3b186dc3cf/users/52a47c8e96214459bd6cf90b1b40a56d/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:54.566780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:54.567136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:54.567479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:54.596995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] MFA Rules not processed for user `52a47c8e96214459bd6cf90b1b40a56d`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:54.598575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:54.734380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1130/2273] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:40:54.739154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:54.839310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb763bc8-faf6-4bf1-ae5a-2097467692bc admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:54.844507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:54.845304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:54.845666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:54.846249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:54.846962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:54.849889 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:54.942785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1144/2274] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:40:54 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:54.946872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:54.958611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d3667-b47e-4fca-97ad-0e230f20e526 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:55.026329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:55.027406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.027406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.027753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.028527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:55.030579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:55.146298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1131/2275] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:40:54 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:40:55.151015 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:55.161533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99b00-9c18-49e3-961e-db97d0a457c6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:55.168030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:55.168030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.168030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.168512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.171339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:55.173100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:55.186336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1145/2276] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:55.190993 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:55.203263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a17bbb-4f64-4b0f-b3c9-1c2ac3d7b4ae admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:55.208900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:55.209833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.210115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.210422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] PATH_INFO: `/v3/projects/7639ff983bc24dc68c2bd210c55e1941/users/4ced12225df148caae2522d72be54f01/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.226346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7639ff983bc24dc68c2bd210c55e1941, user_id=4ced12225df148caae2522d72be54f01, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:55.229855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:55.494624 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1132/2277] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:55 2022] PUT /identity/v3/projects/7639ff983bc24dc68c2bd210c55e1941/users/4ced12225df148caae2522d72be54f01/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:55.494738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:55.510147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0855-3d2b-49c6-a2a7-753413312590 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:55.607691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444adf-9572-46d7-8e20-8c3508ea0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:55.608488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444adf-9572-46d7-8e20-8c3508ea0632 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.608728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444adf-9572-46d7-8e20-8c3508ea0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.609008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444adf-9572-46d7-8e20-8c3508ea0632 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.609765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04444adf-9572-46d7-8e20-8c3508ea0632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:55.611864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04444adf-9572-46d7-8e20-8c3508ea0632 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:55.622549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1146/2278] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:40:55.631983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:55.646109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac37870-40cc-4d23-8d65-a003d561cde5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:55.652353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:55.665640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.665640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.665640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] PATH_INFO: `/v3/projects/7639ff983bc24dc68c2bd210c55e1941/users/4ced12225df148caae2522d72be54f01/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.665640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7639ff983bc24dc68c2bd210c55e1941, user_id=4ced12225df148caae2522d72be54f01, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:55.665640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:55.671977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1133/2279] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:40:55 2022] PUT /identity/v3/projects/7639ff983bc24dc68c2bd210c55e1941/users/4ced12225df148caae2522d72be54f01/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:40:55.683334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.683625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.683905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.725950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] MFA Rules not processed for user `4ced12225df148caae2522d72be54f01`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:55.728755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:55.812129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1147/2280] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:40:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:55.822094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:55.825377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:55.893076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02b107-1059-43da-9937-fcf76fdea0ff admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:55.897316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7121202-7c7e-4695-9467-04f5643e62d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:55.897974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121202-7c7e-4695-9467-04f5643e62d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:55.898274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121202-7c7e-4695-9467-04f5643e62d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:55.898550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7121202-7c7e-4695-9467-04f5643e62d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:55.918984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7121202-7c7e-4695-9467-04f5643e62d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:55.921039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7121202-7c7e-4695-9467-04f5643e62d7 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:55.936792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1134/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:56.117092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:56.119440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:56.132827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76daf876-b5b5-414f-95f7-5ef1326ae0a4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:56.137828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:56.138468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:56.154433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:56.154433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:56.201751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:56.203157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:56.212919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1148/2282] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:40:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:40:56.477890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:56.477890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:56.477890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:56.533434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:40:56.534864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:56.637273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1135/2283] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jan 10 11:40:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:40:56.645868 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:40:56.647772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:40:56.756404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482f413-8de7-4168-a04d-ea0261c706ad service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:40:56.762315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53dfcb-693b-4093-9f7a-f57c60afcad2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:40:56.762987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53dfcb-693b-4093-9f7a-f57c60afcad2 service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:40:56.763270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53dfcb-693b-4093-9f7a-f57c60afcad2 service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:40:56.763546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53dfcb-693b-4093-9f7a-f57c60afcad2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:40:56.774939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53dfcb-693b-4093-9f7a-f57c60afcad2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:40:56.776326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53dfcb-693b-4093-9f7a-f57c60afcad2 service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:40:56.786635 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1149/2284] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:40:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:41:01.840422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:01.902808 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000db6c-0f88-4568-8cbc-839324fce2a0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:01.907763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:01.908687 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:01.908910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:01.910096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] PATH_INFO: `/v3/users/52a47c8e96214459bd6cf90b1b40a56d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:01.910433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a47c8e96214459bd6cf90b1b40a56d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:01.912415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:02.104191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a47c8e96214459bd6cf90b1b40a56d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:02.116327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a47c8e96214459bd6cf90b1b40a56d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:02.117071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a47c8e96214459bd6cf90b1b40a56d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:02.124822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a47c8e96214459bd6cf90b1b40a56d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:02.236937 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a47c8e96214459bd6cf90b1b40a56d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:02.244259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1136/2285] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:01 2022] DELETE /identity/v3/users/52a47c8e96214459bd6cf90b1b40a56d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:02.249108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:02.250093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:02.250615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:02.269376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:02.270660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:02.332213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1150/2286] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:02.343072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:02.344562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:02.408207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb13072-e812-4035-9bdf-6e93297f0a41 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:02.412184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:02.412857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:02.413136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:02.413416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:02.423893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:02.425370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:02.436199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1137/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:02.919523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:02.921217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:02.935433 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef4341-b76e-4ba9-9e28-404f4eaffcd9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:02.940964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:02.941913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:02.942383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:02.942681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] PATH_INFO: `/v3/projects/2524fc1d3ee2482a962ecf3b186dc3cf` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:02.944020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2524fc1d3ee2482a962ecf3b186dc3cf)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:02.953970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:03.069321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2524fc1d3ee2482a962ecf3b186dc3cf', 'request_id': 'req-2827a4a3-5159-4feb-a474-c37ad6abcd90'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.169048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2524fc1d3ee2482a962ecf3b186dc3cf', 'request_id': 'req-2827a4a3-5159-4feb-a474-c37ad6abcd90'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.175928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2524fc1d3ee2482a962ecf3b186dc3cf', 'request_id': 'req-2827a4a3-5159-4feb-a474-c37ad6abcd90'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.186345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] The token cache is being invalidate because project 2524fc1d3ee2482a962ecf3b186dc3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:03.186627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.187254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.188774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1151/2288] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:02 2022] DELETE /identity/v3/projects/2524fc1d3ee2482a962ecf3b186dc3cf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:03.192832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:03.202901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680125-d035-48d6-acbc-5ac4fabac153 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:03.260317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:03.261204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:03.261486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:03.261758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] PATH_INFO: `/v3/users/4ced12225df148caae2522d72be54f01` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:03.263094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ced12225df148caae2522d72be54f01)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:03.265096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:03.638595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ced12225df148caae2522d72be54f01'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.650550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ced12225df148caae2522d72be54f01'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.651232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ced12225df148caae2522d72be54f01'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.657827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ced12225df148caae2522d72be54f01'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.776439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1c63f6cc-798a-49bf-9ea7-1d2132871c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ced12225df148caae2522d72be54f01'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:03.782933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1138/2289] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:03 2022] DELETE /identity/v3/users/4ced12225df148caae2522d72be54f01 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:04.358246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:04.359936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:04.373709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827a4a3-5159-4feb-a474-c37ad6abcd90 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:04.433538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:04.434438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:04.434717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:04.434994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] PATH_INFO: `/v3/projects/7639ff983bc24dc68c2bd210c55e1941` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:04.436215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7639ff983bc24dc68c2bd210c55e1941)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:04.438124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:04.566513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7639ff983bc24dc68c2bd210c55e1941', 'request_id': 'req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:04.631335 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7639ff983bc24dc68c2bd210c55e1941', 'request_id': 'req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:04.639205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7639ff983bc24dc68c2bd210c55e1941', 'request_id': 'req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:04.652837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] The token cache is being invalidate because project 7639ff983bc24dc68c2bd210c55e1941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:04.653127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:04.653856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-f4e74c25-dce1-4c6c-9f13-e8bae4ee386e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:04.655522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1152/2290] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:04 2022] DELETE /identity/v3/projects/7639ff983bc24dc68c2bd210c55e1941 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:04.661619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:04.662172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:04.662172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:04.690376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:04.691611 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:04.754436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1139/2291] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:04.764701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:04.764985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:04.765266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:04.785569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:04.786964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:04.797097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1153/2292] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:04.801459 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:04.813648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e77d0-4751-45f7-a8d7-43bd9b18255b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:04.818041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:04.818811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:04.819091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:04.819365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:04.820121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:04.820436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:04.822691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:04.835481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1140/2293] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:41:04.840569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:04.850041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc07146-641a-432e-92d2-bd44a04d9fd5 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:04.855206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:04.855823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:04.856148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:04.856471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:04.857092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:04.859134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:04.945337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1154/2294] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:04 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:04.947432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:04.957395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472499-91e0-4e96-913a-31aa4551cfce admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.015225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.016164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.016922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.017209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.017928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.019919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.128965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1141/2295] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:04 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:05.132963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.144042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372ef5f-6d6b-4c49-ad0b-b34da599aeb2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.148554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.149214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.149497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.149814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.151301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.152893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.163377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1155/2296] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:05.167554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.178045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0170-93d0-40e7-b3ff-334f263ed138 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.183310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cf52-6ba6-4793-9a93-14994454dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.184297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cf52-6ba6-4793-9a93-14994454dee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.184730 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cf52-6ba6-4793-9a93-14994454dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.194710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cf52-6ba6-4793-9a93-14994454dee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.194710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36cf52-6ba6-4793-9a93-14994454dee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.194710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36cf52-6ba6-4793-9a93-14994454dee3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.198644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1142/2297] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:05.202880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.213327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13101c1-4d2c-4298-ad3f-4897713d386d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.218261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.219156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.219436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.219714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] PATH_INFO: `/v3/projects/79f34c28904040309374c5ab47bb55b5/users/5fdf033aab5f48c68559edd28d50c1e0/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.235100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f34c28904040309374c5ab47bb55b5, user_id=5fdf033aab5f48c68559edd28d50c1e0, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.238022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.347705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1156/2298] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:05 2022] PUT /identity/v3/projects/79f34c28904040309374c5ab47bb55b5/users/5fdf033aab5f48c68559edd28d50c1e0/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:05.359369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.359653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.359930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.388574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] MFA Rules not processed for user `5fdf033aab5f48c68559edd28d50c1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:05.389815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:05.457066 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1143/2299] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:05.461653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.526329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cff47-3083-4d15-8ac8-cc78beb1cf18 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.531250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.531904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.532185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.532459 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.534460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.535226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.639883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1157/2300] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:05 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:05.643826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.655483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0a5b-ef81-4266-94f6-36ed99f2ad10 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.714293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.715026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.715307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.715612 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.716342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.718305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.843871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1144/2301] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:05 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:05.847933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.859069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127f55-0474-41cd-9e11-6e90371aedf9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.864205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.864869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.865153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.865456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.866194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.867820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.879216 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1158/2302] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:05.883518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:05.893736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1abe5-f715-454e-8bd4-c5a6fb6080cb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:05.898800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:05.899711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:05.900145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:05.900683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] PATH_INFO: `/v3/projects/bdbaab76c97c45648c28140cb60dc629/users/a6b2557766454d96b5e899a1fcc6fa24/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:05.915286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbaab76c97c45648c28140cb60dc629, user_id=a6b2557766454d96b5e899a1fcc6fa24, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:05.918583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:05.987214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1145/2303] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:05 2022] PUT /identity/v3/projects/bdbaab76c97c45648c28140cb60dc629/users/a6b2557766454d96b5e899a1fcc6fa24/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:05.991171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:06.001645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232614cd-5feb-48a2-b6e2-a9d63a0aa137 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:06.055262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae8991-3770-442a-bb71-fa18ce1576d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:06.055940 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8991-3770-442a-bb71-fa18ce1576d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:06.056856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8991-3770-442a-bb71-fa18ce1576d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:06.057133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae8991-3770-442a-bb71-fa18ce1576d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:06.057902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae8991-3770-442a-bb71-fa18ce1576d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:06.059519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae8991-3770-442a-bb71-fa18ce1576d3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:06.069156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1159/2304] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:06.073668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:06.083851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ecc3d-9748-4c11-96b3-0ebf8d71cf86 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:06.088772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:06.090092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:06.090092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:06.090344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] PATH_INFO: `/v3/projects/bdbaab76c97c45648c28140cb60dc629/users/a6b2557766454d96b5e899a1fcc6fa24/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:06.092275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbaab76c97c45648c28140cb60dc629, user_id=a6b2557766454d96b5e899a1fcc6fa24, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:06.094944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:06.105948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1146/2305] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:06 2022] PUT /identity/v3/projects/bdbaab76c97c45648c28140cb60dc629/users/a6b2557766454d96b5e899a1fcc6fa24/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:06.116182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:06.116501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:06.116778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:06.142646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] MFA Rules not processed for user `a6b2557766454d96b5e899a1fcc6fa24`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:06.143891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:06.211214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1160/2306] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:06.221867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:06.223603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:06.281151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4d4f0-1e4b-4aae-ab86-375f74f3d3e3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:06.284983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7588a-a2ad-4bf2-b5a2-7879c734c775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:06.285616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7588a-a2ad-4bf2-b5a2-7879c734c775 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:06.285894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7588a-a2ad-4bf2-b5a2-7879c734c775 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:06.286163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7588a-a2ad-4bf2-b5a2-7879c734c775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:06.296075 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7588a-a2ad-4bf2-b5a2-7879c734c775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:06.297512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7588a-a2ad-4bf2-b5a2-7879c734c775 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:06.306995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1147/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:07.668149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:07.741606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec65fb-9c70-477d-a8f7-291e4f2b0188 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:07.746266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:07.747158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:07.747409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:07.747677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] PATH_INFO: `/v3/users/5fdf033aab5f48c68559edd28d50c1e0` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:07.748928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdf033aab5f48c68559edd28d50c1e0)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:07.750962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:08.015639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdf033aab5f48c68559edd28d50c1e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:08.023089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdf033aab5f48c68559edd28d50c1e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:08.023765 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdf033aab5f48c68559edd28d50c1e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:08.024398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdf033aab5f48c68559edd28d50c1e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:08.036650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdf033aab5f48c68559edd28d50c1e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:08.147499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1161/2308] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:07 2022] DELETE /identity/v3/users/5fdf033aab5f48c68559edd28d50c1e0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:08.152519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:08.153590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:08.153590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:08.173415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:08.174737 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:08.248258 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1148/2309] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:08.258778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:08.261041 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:08.335775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201e6b4-d4e1-438d-9b63-aea47907d2eb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:08.340797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:08.341751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:08.342125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:08.342510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:08.355595 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:08.357590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:08.369050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1162/2310] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:08.987142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:08.989389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:09.004251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1098a7-9997-45bd-b9c1-577b87bf96d4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:09.010814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:09.014876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:09.014876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:09.014876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] PATH_INFO: `/v3/projects/79f34c28904040309374c5ab47bb55b5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:09.014876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f34c28904040309374c5ab47bb55b5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:09.016321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:09.180357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f34c28904040309374c5ab47bb55b5', 'request_id': 'req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.312840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f34c28904040309374c5ab47bb55b5', 'request_id': 'req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.320510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f34c28904040309374c5ab47bb55b5', 'request_id': 'req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.336932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] The token cache is being invalidate because project 79f34c28904040309374c5ab47bb55b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:09.337327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.338074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.341467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1149/2311] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:08 2022] DELETE /identity/v3/projects/79f34c28904040309374c5ab47bb55b5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:09.345717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:09.356493 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1baf26-5e40-4e56-ae61-dd5d5f96908b service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:09.422449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:09.423241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:09.423517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:09.423792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] PATH_INFO: `/v3/users/a6b2557766454d96b5e899a1fcc6fa24` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:09.425062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b2557766454d96b5e899a1fcc6fa24)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:09.427066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:09.625523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b2557766454d96b5e899a1fcc6fa24'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.632225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b2557766454d96b5e899a1fcc6fa24'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.632916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b2557766454d96b5e899a1fcc6fa24'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.633514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b2557766454d96b5e899a1fcc6fa24'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.645168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b2557766454d96b5e899a1fcc6fa24'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:09.749005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1163/2312] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:09 2022] DELETE /identity/v3/users/a6b2557766454d96b5e899a1fcc6fa24 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:10.447634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:10.449626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:10.464429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf1d1-7d00-46d7-beb3-efb5ec3ca087 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:10.571151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:10.573584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:10.573936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:10.574328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] PATH_INFO: `/v3/projects/bdbaab76c97c45648c28140cb60dc629` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:10.576208 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbaab76c97c45648c28140cb60dc629)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:10.578169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:10.726116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:10.727713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:10.735839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbaab76c97c45648c28140cb60dc629', 'request_id': 'req-752340e4-8b33-4497-a51d-1934fa8371fb'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:10.743324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ff80-a6e7-457a-8f08-e8e31c60633b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:10.806778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:10.807614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:10.807901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:10.808179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] PATH_INFO: `/v3/users/b6431c85b6c74608aae42e0e856d1a6d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:10.809461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6431c85b6c74608aae42e0e856d1a6d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:10.811432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:10.815126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbaab76c97c45648c28140cb60dc629', 'request_id': 'req-752340e4-8b33-4497-a51d-1934fa8371fb'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:10.823753 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbaab76c97c45648c28140cb60dc629', 'request_id': 'req-752340e4-8b33-4497-a51d-1934fa8371fb'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:10.835748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] The token cache is being invalidate because project bdbaab76c97c45648c28140cb60dc629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:10.836146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:10.836926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-752340e4-8b33-4497-a51d-1934fa8371fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:10.838555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1150/2313] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:10 2022] DELETE /identity/v3/projects/bdbaab76c97c45648c28140cb60dc629 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:10.849418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba830b-1ecc-4907-b387-da677956d57a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:10.849697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba830b-1ecc-4907-b387-da677956d57a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:10.849969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba830b-1ecc-4907-b387-da677956d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:10.870048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-47ba830b-1ecc-4907-b387-da677956d57a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:10.871407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-47ba830b-1ecc-4907-b387-da677956d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:10.879961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1151/2314] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:10.890517 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:10.890802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:10.891081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:10.910318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:10.911524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:10.919715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1152/2315] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:10.924143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:10.934977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bb310-6d5a-40a6-9567-1c742e8b871e None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:10.940184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:10.941032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:10.941257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:10.941533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:10.944662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:10.944662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:10.944662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:10.956984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1153/2316] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:41:10.961321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:10.978683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212870e-46dd-4fbc-a2d2-7b9397aa6617 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:10.978683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:10.978683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:10.978683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:10.979342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:10.979342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:10.981265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.046694 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6431c85b6c74608aae42e0e856d1a6d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.053407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6431c85b6c74608aae42e0e856d1a6d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.054051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6431c85b6c74608aae42e0e856d1a6d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.054690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6431c85b6c74608aae42e0e856d1a6d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.067277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6431c85b6c74608aae42e0e856d1a6d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.109403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1154/2317] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:10 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:11.113953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.115565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:11.187502 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1164/2318] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:10 2022] DELETE /identity/v3/users/b6431c85b6c74608aae42e0e856d1a6d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:11.188531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a014ec7-64f9-4655-b9b3-92f66bad321a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.252437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.253903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.253903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.254092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.254728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.257317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.398710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1155/2319] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:11 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:11.403630 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.413687 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7878a-6d14-4215-8d35-e7e2f7cfa890 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.418518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.419366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.419647 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.419921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.420689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.422305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.433306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1165/2320] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:11.438970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.450428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780eacb-8e9e-4f22-bcf9-2f63e2b551b8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.455113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.455774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.456048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.456316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.457052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.458708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.469372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.472128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:11.474962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1156/2321] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:11.475852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.487313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec9714-2c9d-41c4-8c75-b011ad2301df admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.495283 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84991340-3fe8-41e0-8520-f6db4ddcc4ac admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.498257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.499411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.499743 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.500019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] PATH_INFO: `/v3/projects/1c300abbfb3b48dab6c40f20c7eb9cd1` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.501411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c300abbfb3b48dab6c40f20c7eb9cd1)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.504099 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.507485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a041b53-29e3-4772-b07c-8137abcf7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.508392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a041b53-29e3-4772-b07c-8137abcf7855 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.508722 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a041b53-29e3-4772-b07c-8137abcf7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.509026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a041b53-29e3-4772-b07c-8137abcf7855 admin admin] PATH_INFO: `/v3/projects/d95221475cea46b78b13c702f6aabf16/users/5b2b091f319443bfb51212ee01f02019/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.528249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a041b53-29e3-4772-b07c-8137abcf7855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95221475cea46b78b13c702f6aabf16, user_id=5b2b091f319443bfb51212ee01f02019, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.530951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a041b53-29e3-4772-b07c-8137abcf7855 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.627481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1157/2322] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:11 2022] PUT /identity/v3/projects/d95221475cea46b78b13c702f6aabf16/users/5b2b091f319443bfb51212ee01f02019/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:11.637227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'request_id': 'req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.638738 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.639104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.639386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.678016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] MFA Rules not processed for user `5b2b091f319443bfb51212ee01f02019`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:11.679298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:11.742809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'request_id': 'req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.752485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'request_id': 'req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.754788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1158/2323] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:11.760120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.770267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] The token cache is being invalidate because project 1c300abbfb3b48dab6c40f20c7eb9cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:11.770762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.771484 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c7a82c9c-0a58-49b9-be44-bc64044fc6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:11.773798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1166/2324] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:11 2022] DELETE /identity/v3/projects/1c300abbfb3b48dab6c40f20c7eb9cd1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:11.785880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f752-a6d6-4ec0-93a7-c265816cd98f None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.785880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f752-a6d6-4ec0-93a7-c265816cd98f None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.785880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f752-a6d6-4ec0-93a7-c265816cd98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.801789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6193f752-a6d6-4ec0-93a7-c265816cd98f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:11.803045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6193f752-a6d6-4ec0-93a7-c265816cd98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:11.856657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac82e-56bc-4429-bae6-78c3a42f0a17 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.865149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.866317 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.866756 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.867173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.868367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.872485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.883506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1167/2325] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:11.891578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.891847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.892135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.914876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:11.917002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:11.925627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1168/2326] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:11.930650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.948976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dd0d4-59d9-4600-bdcf-6c6a338c360b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:11.956672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:11.957770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:11.958329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:11.958820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:11.960242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:11.960790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:11.964395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:11.981017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1169/2327] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:41:11.986661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:11.999815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbf8c-b03a-40cb-937e-6561a1bc3b38 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.005559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.005559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.005559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.005846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.006576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.008520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.035037 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1159/2328] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:12.039173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.041079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:12.108365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafff0f-5e40-4991-896c-0e20059212c9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.113305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.113952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.114250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.114526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.115232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.117254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.123436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1170/2329] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:11 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:12.124408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.186350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d627d-86d7-4762-8fa5-2073444c6bb5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.191115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.191808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.192087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.192363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.193075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.195050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.221048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1160/2330] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:12 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:12.229214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.235102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d8ec8-a776-458c-8397-194df45dc9e6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.240022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.240660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.240940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.241215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.241944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.244141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.254114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1161/2331] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:12.258969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.270057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc935-d57c-4800-ae81-954b82fad981 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.274960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.275899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.276174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.276543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] PATH_INFO: `/v3/projects/e8374716f54f4c2bbd0370c223cfb8e2/users/55dc9497b21b43fdaf50d18453b0e9dc/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.293288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8374716f54f4c2bbd0370c223cfb8e2, user_id=55dc9497b21b43fdaf50d18453b0e9dc, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.296222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.342680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1171/2332] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:12 2022] POST /identity/v3/users => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:12.347752 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.357706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df0f6-03c5-4a9d-a5b5-af0a0474d8b6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.362690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.363304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.363584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.363857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.364620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.366238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.376808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1172/2333] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:12.380894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.391909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83eac-5d87-46b8-80f7-0587c4f9cd9a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.396793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.397305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.397588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.397861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.398643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.400348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.411487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1173/2334] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:12.415859 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1162/2335] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:12 2022] PUT /identity/v3/projects/e8374716f54f4c2bbd0370c223cfb8e2/users/55dc9497b21b43fdaf50d18453b0e9dc/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:12.416061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.422637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.426652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccecbc-fab8-4e8a-8992-1c48f398d3d2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.484353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acecef-6c95-4d21-baaa-9c04a4e147f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.485415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acecef-6c95-4d21-baaa-9c04a4e147f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.485697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acecef-6c95-4d21-baaa-9c04a4e147f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.485976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acecef-6c95-4d21-baaa-9c04a4e147f4 admin admin] PATH_INFO: `/v3/projects/3c2f3aba9b2f400eb083d419baf62aea/users/5240eb8155c7445091172dabd10da279/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.488800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b5dee-b64a-4cf3-80d1-3ea47321b8b5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.494253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.494967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.495240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.495510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.496249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.497853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.504391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acecef-6c95-4d21-baaa-9c04a4e147f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2f3aba9b2f400eb083d419baf62aea, user_id=5240eb8155c7445091172dabd10da279, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.507088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acecef-6c95-4d21-baaa-9c04a4e147f4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.509270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1163/2336] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:12.514019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.523972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d9a3-e05c-4513-b92b-10811c2396f0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.528798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b119fd-9e66-4ed4-a2ae-8c78b9a2fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.529665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b119fd-9e66-4ed4-a2ae-8c78b9a2fe90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.529943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b119fd-9e66-4ed4-a2ae-8c78b9a2fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.530229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b119fd-9e66-4ed4-a2ae-8c78b9a2fe90 admin admin] PATH_INFO: `/v3/projects/e8374716f54f4c2bbd0370c223cfb8e2/users/55dc9497b21b43fdaf50d18453b0e9dc/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.532228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b119fd-9e66-4ed4-a2ae-8c78b9a2fe90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8374716f54f4c2bbd0370c223cfb8e2, user_id=55dc9497b21b43fdaf50d18453b0e9dc, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.535058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b119fd-9e66-4ed4-a2ae-8c78b9a2fe90 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.547712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1164/2337] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:12 2022] PUT /identity/v3/projects/e8374716f54f4c2bbd0370c223cfb8e2/users/55dc9497b21b43fdaf50d18453b0e9dc/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:12.558736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.559020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.559282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.584684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] MFA Rules not processed for user `55dc9497b21b43fdaf50d18453b0e9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:12.585928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:12.611692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1174/2338] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:12 2022] PUT /identity/v3/projects/3c2f3aba9b2f400eb083d419baf62aea/users/5240eb8155c7445091172dabd10da279/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:12.617116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfcefb-9926-4417-9204-af058469101b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.617334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfcefb-9926-4417-9204-af058469101b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.617610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfcefb-9926-4417-9204-af058469101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.638080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e9cfcefb-9926-4417-9204-af058469101b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:12.639581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e9cfcefb-9926-4417-9204-af058469101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:12.673407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1165/2339] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:12.683478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.684896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:12.705742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1175/2340] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:12.715266 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfcefb-9926-4417-9204-af058469101b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:12.716657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e9cfcefb-9926-4417-9204-af058469101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:12.743569 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb91670-a32f-41e0-a560-d546b0d21b2a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.774638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfcefb-9926-4417-9204-af058469101b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:12.778411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.779055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.779343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.779619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.788867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.790343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.792619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f2552-a920-4555-af5e-4caea65d3b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:12.793270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f2552-a920-4555-af5e-4caea65d3b0d service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:12.793547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f2552-a920-4555-af5e-4caea65d3b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:12.793984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f2552-a920-4555-af5e-4caea65d3b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:12.800775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1176/2341] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:12.857688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f2552-a920-4555-af5e-4caea65d3b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:12.859234 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f2552-a920-4555-af5e-4caea65d3b0d service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:12.870003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1166/2342] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:13.411406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:13.423300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8296f-9c6c-4c21-a450-c5f2e17677f2 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:13.428036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:13.428953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:13.429379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:13.429663 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] PATH_INFO: `/v3/users/5b2b091f319443bfb51212ee01f02019` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:13.430999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2b091f319443bfb51212ee01f02019)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:13.434193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:13.789432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2b091f319443bfb51212ee01f02019'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:13.796715 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2b091f319443bfb51212ee01f02019'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:13.797429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2b091f319443bfb51212ee01f02019'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:13.798044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2b091f319443bfb51212ee01f02019'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:13.810499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2b091f319443bfb51212ee01f02019'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:13.929860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1177/2343] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:13 2022] DELETE /identity/v3/users/5b2b091f319443bfb51212ee01f02019 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:13.935187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:13.935709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:13.935709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:13.953840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:13.955001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.021011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1167/2344] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:14.031121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:14.032972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.095391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada8d1d-ff0d-48c8-9ee9-72dd9765634d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:14.099239 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2582-f165-4664-aef9-f13e02f778f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:14.099905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2582-f165-4664-aef9-f13e02f778f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.100185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2582-f165-4664-aef9-f13e02f778f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.100458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2582-f165-4664-aef9-f13e02f778f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.110884 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e2582-f165-4664-aef9-f13e02f778f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:14.112626 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e2582-f165-4664-aef9-f13e02f778f0 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:14.122446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1178/2345] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:14.199822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:14.201224 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.213281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873f63a-e92d-42e8-8657-00c23e262472 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:14.218125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:14.219218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.219495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.219768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] PATH_INFO: `/v3/users/e5d1abe7ad94433b8a6aec49af55c4fe` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.221024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d1abe7ad94433b8a6aec49af55c4fe)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:14.222992 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:14.377876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.378710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.379407 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.427898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] MFA Rules not processed for user `5240eb8155c7445091172dabd10da279`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:14.429394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.493184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d1abe7ad94433b8a6aec49af55c4fe'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:14.515717 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1179/2346] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:14.516685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:14.518102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.529591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d1abe7ad94433b8a6aec49af55c4fe'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:14.534537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d1abe7ad94433b8a6aec49af55c4fe'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:14.537936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101c569-eafe-4cbe-8acc-0014db87df1a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:14.543058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d1abe7ad94433b8a6aec49af55c4fe'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:14.543970 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:14.544653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.544939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.545606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.546473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:14.549398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:14.644254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-984fa59e-a029-4211-ad39-c41535001fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d1abe7ad94433b8a6aec49af55c4fe'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:14.651244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1168/2347] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:14 2022] DELETE /identity/v3/users/e5d1abe7ad94433b8a6aec49af55c4fe => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:14.655802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.656081 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.656355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.673995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:14.675269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.695589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1180/2348] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:14 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:14.700754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:14.700754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.747344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1169/2349] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:14.748273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:14.749638 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:14.762739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bfbdf-49f0-4639-9267-9090f555f264 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:14.774625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f3ed8-877a-48d3-9fe9-5ffb0bbc8188 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:14.780143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:14.781578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.781862 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.782560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] PATH_INFO: `/v3/projects/d95221475cea46b78b13c702f6aabf16` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.783439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95221475cea46b78b13c702f6aabf16)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:14.785346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:14.821179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:14.821962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:14.822340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:14.826617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:14.826617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:14.826617 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:14.902268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95221475cea46b78b13c702f6aabf16', 'request_id': 'req-21c5cce1-f522-43d8-a235-355d7fed60b9'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:14.941664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1170/2350] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:14 2022] POST /identity/v3/users => generated 309 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:14.946657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:14.946657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:15.002542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578b03-0a34-4e30-8477-b6d64f4fddab admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.015351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95221475cea46b78b13c702f6aabf16', 'request_id': 'req-21c5cce1-f522-43d8-a235-355d7fed60b9'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.024019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95221475cea46b78b13c702f6aabf16', 'request_id': 'req-21c5cce1-f522-43d8-a235-355d7fed60b9'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.035590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] The token cache is being invalidate because project d95221475cea46b78b13c702f6aabf16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:15.035876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.036731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.038258 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1181/2351] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:14 2022] DELETE /identity/v3/projects/d95221475cea46b78b13c702f6aabf16 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:15.039142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:15.044100 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:15.061153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.061801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.062076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.062389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.064169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:15.104865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5cce1-f522-43d8-a235-355d7fed60b9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.109615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.110302 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.110589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.110859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.111740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.113619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.124132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1182/2352] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:15.124132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:15.124132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:15.131263 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.132726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.139840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc588e25-1954-48a7-af9d-738d372b3b9d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.143076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1171/2353] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:15.143988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:15.144539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.145438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.145720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.145991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] PATH_INFO: `/v3/users/55dc9497b21b43fdaf50d18453b0e9dc` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.147276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55dc9497b21b43fdaf50d18453b0e9dc)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.149217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.154468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569cd24-9bcb-49e1-a6db-dd8a368502c1 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.160342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.161244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.161528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.161829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] PATH_INFO: `/v3/projects/94a734a165b148febde15a3fde7ec197/users/35f0709568e24d3fa6359e2bc38c3e80/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.177775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a734a165b148febde15a3fde7ec197, user_id=35f0709568e24d3fa6359e2bc38c3e80, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.180800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.444040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1172/2354] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:15 2022] PUT /identity/v3/projects/94a734a165b148febde15a3fde7ec197/users/35f0709568e24d3fa6359e2bc38c3e80/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:15.448777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:15.495829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55dc9497b21b43fdaf50d18453b0e9dc'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.515286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55dc9497b21b43fdaf50d18453b0e9dc'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.516522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55dc9497b21b43fdaf50d18453b0e9dc'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.517281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55dc9497b21b43fdaf50d18453b0e9dc'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.532312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55dc9497b21b43fdaf50d18453b0e9dc'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.537311 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8be7ff-166b-4f72-8b59-a70d1bc01b57 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.544001 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.544713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.544997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.545393 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.546148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.551618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.559333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1173/2355] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:15.563783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:15.565499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:15.580629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d0b8-ace5-4f80-ba04-b69a582e2d9d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.585648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844b1a2-96fb-482e-8b37-d6e704ccb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.586580 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b1a2-96fb-482e-8b37-d6e704ccb138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.586857 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b1a2-96fb-482e-8b37-d6e704ccb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.587125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844b1a2-96fb-482e-8b37-d6e704ccb138 admin admin] PATH_INFO: `/v3/projects/94a734a165b148febde15a3fde7ec197/users/35f0709568e24d3fa6359e2bc38c3e80/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.589250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b1a2-96fb-482e-8b37-d6e704ccb138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a734a165b148febde15a3fde7ec197, user_id=35f0709568e24d3fa6359e2bc38c3e80, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.592222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844b1a2-96fb-482e-8b37-d6e704ccb138 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.606053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1183/2356] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:15 2022] DELETE /identity/v3/users/55dc9497b21b43fdaf50d18453b0e9dc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:15.613854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1174/2357] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:15 2022] PUT /identity/v3/projects/94a734a165b148febde15a3fde7ec197/users/35f0709568e24d3fa6359e2bc38c3e80/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:15.721106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:15.722909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:15.799161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32638d8-12c2-41a5-ae86-b89761921bd1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:15.803842 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:15.804707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:15.804991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:15.805264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] PATH_INFO: `/v3/projects/b4729d5fc6854e13b331e0ca69db54fd` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:15.806610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4729d5fc6854e13b331e0ca69db54fd)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:15.808637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:15.923187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4729d5fc6854e13b331e0ca69db54fd', 'request_id': 'req-805ba30c-e101-48a7-be2f-c21aad6b2d6c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.981203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4729d5fc6854e13b331e0ca69db54fd', 'request_id': 'req-805ba30c-e101-48a7-be2f-c21aad6b2d6c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:15.988558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4729d5fc6854e13b331e0ca69db54fd', 'request_id': 'req-805ba30c-e101-48a7-be2f-c21aad6b2d6c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.002040 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] The token cache is being invalidate because project b4729d5fc6854e13b331e0ca69db54fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:16.002370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.003652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-805ba30c-e101-48a7-be2f-c21aad6b2d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.012721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1184/2358] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:15 2022] DELETE /identity/v3/projects/b4729d5fc6854e13b331e0ca69db54fd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:16.013145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.013145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.013145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.032334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:16.033555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.097313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1175/2359] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:16.105353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.105712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.107310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.125316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:16.126547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.134452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1185/2360] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:16.139502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.149681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcf939-a6a3-405f-a463-9c4a0ff88df0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.154610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.155309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.155590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.155862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.156602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:16.156950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.158599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.173887 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1176/2361] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:41:16.175197 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.185215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e6038-9e54-483c-8a70-2c797cd7a0cc None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.189890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.190561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.190872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.191172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.191869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.193778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.216346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.218095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.231960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdb69-ed31-4700-853e-f1fa7e09eee9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.237342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.238235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.239048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.239482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] PATH_INFO: `/v3/projects/e8374716f54f4c2bbd0370c223cfb8e2` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.241908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8374716f54f4c2bbd0370c223cfb8e2)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.244784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.296899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1186/2362] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:16.299778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.363339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec106b7-4db7-4a2b-b284-56e674d7f831 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.364356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8374716f54f4c2bbd0370c223cfb8e2', 'request_id': 'req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.420716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.421888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.422297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.422582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.423395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.425612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.472516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8374716f54f4c2bbd0370c223cfb8e2', 'request_id': 'req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.478850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8374716f54f4c2bbd0370c223cfb8e2', 'request_id': 'req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.492019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] The token cache is being invalidate because project e8374716f54f4c2bbd0370c223cfb8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:16.492453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.493156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0185ec50-fc12-4b19-83e7-fe2f86ecf52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:16.494908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1177/2363] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:16 2022] DELETE /identity/v3/projects/e8374716f54f4c2bbd0370c223cfb8e2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:16.500369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525eba0-63af-4e67-af80-180bdd224cc3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.500647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525eba0-63af-4e67-af80-180bdd224cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.500987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525eba0-63af-4e67-af80-180bdd224cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.522107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6525eba0-63af-4e67-af80-180bdd224cc3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:16.523339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6525eba0-63af-4e67-af80-180bdd224cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.532904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1178/2364] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:16.537119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1187/2365] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:16.540648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.541290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.541610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.542026 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.543403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.555579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0868c-1056-4d45-bcdb-d9e09bbd221b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.560405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.561068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.564627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.564627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.564845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:16.564946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.565036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.565126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.577307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1179/2366] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:16.577507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1188/2367] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:16.578901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.581319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.590767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809c724-6f46-4b3f-951e-1b6ef09dd07d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.592238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb691e8a-95cb-442e-957c-d79285360eec admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.596625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.597415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.597554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.597850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.598101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.598263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.598548 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.598771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.599225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:16.599421 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.599727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.601355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.602652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.615199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1189/2368] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:16.619711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.624603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1180/2369] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:41:16.625983 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.632189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f911b99-06b9-43ed-aa6b-4835b66c1b12 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.637715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583d82-541a-47da-b001-20dbbd5cfcd1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:16.637883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.638872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.639077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.639361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] PATH_INFO: `/v3/projects/461c05e73d8c4f928a62c796c018f5f0/users/4f4bcf678ddb4f0099c3950014a94817/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.643484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb9977-9dc1-4e8f-8bc2-7f4ad13673ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:16.644318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9977-9dc1-4e8f-8bc2-7f4ad13673ed admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.644561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9977-9dc1-4e8f-8bc2-7f4ad13673ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.644902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9977-9dc1-4e8f-8bc2-7f4ad13673ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.645668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb9977-9dc1-4e8f-8bc2-7f4ad13673ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.647891 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb9977-9dc1-4e8f-8bc2-7f4ad13673ed admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.657305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461c05e73d8c4f928a62c796c018f5f0, user_id=4f4bcf678ddb4f0099c3950014a94817, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:16.660295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:16.884660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1190/2370] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:16 2022] PUT /identity/v3/projects/461c05e73d8c4f928a62c796c018f5f0/users/4f4bcf678ddb4f0099c3950014a94817/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:16.886503 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1181/2371] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:16.891013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:16.895538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:16.895823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:16.896098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:16.926329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] MFA Rules not processed for user `4f4bcf678ddb4f0099c3950014a94817`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:16.929106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:16.957539 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329c18b-3958-4220-a740-7c12a6c035a4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.002199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1182/2372] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:17.013604 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:17.015183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:17.034090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.039640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.039640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.039640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.039640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.039640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.093646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965de1a-4752-4da1-a7cd-d9479590ef7f None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.099151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449afeb-27e7-4cb9-83bf-171f551a07df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.099977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449afeb-27e7-4cb9-83bf-171f551a07df service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.100391 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449afeb-27e7-4cb9-83bf-171f551a07df service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.100748 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449afeb-27e7-4cb9-83bf-171f551a07df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.111048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449afeb-27e7-4cb9-83bf-171f551a07df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.112923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449afeb-27e7-4cb9-83bf-171f551a07df service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.123565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1183/2373] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:17.125132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.125588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.126139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.157574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] MFA Rules not processed for user `35f0709568e24d3fa6359e2bc38c3e80`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:17.158613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:17.167885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1191/2374] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:16 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:17.169046 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:17.184220 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814e6a5-37ef-4577-940e-fc3d9c4a9d33 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.190489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.191391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.191844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.192281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.193450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.196517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.211057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1192/2375] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:17.215061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:17.226560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dec7b-2d9a-4108-8aad-6f6ac2e09adf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.235400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11bbf2-4ad4-46b0-883d-e5070658fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.236176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11bbf2-4ad4-46b0-883d-e5070658fe81 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.237298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11bbf2-4ad4-46b0-883d-e5070658fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.237298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11bbf2-4ad4-46b0-883d-e5070658fe81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.237982 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11bbf2-4ad4-46b0-883d-e5070658fe81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.239800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11bbf2-4ad4-46b0-883d-e5070658fe81 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.247274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1184/2376] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:17.257672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1193/2377] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:17.258828 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:17.271083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fac613-e711-4a28-bb88-e39fffb11c08 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.277368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.278538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.279045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.279418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] PATH_INFO: `/v3/projects/f64eac1260384954894c2e5a11b787f7/users/56794466df98445eac0abf3c612b63d8/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.297995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64eac1260384954894c2e5a11b787f7, user_id=56794466df98445eac0abf3c612b63d8, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.300972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.428415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1185/2378] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:17 2022] PUT /identity/v3/projects/f64eac1260384954894c2e5a11b787f7/users/56794466df98445eac0abf3c612b63d8/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:17.440069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.440445 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.440811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.470017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] MFA Rules not processed for user `56794466df98445eac0abf3c612b63d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:17.471246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:17.535101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1194/2379] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:17.554138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:17.616505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649d934-a3ee-460d-a5e5-43c2d329a4ae admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.622429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6db5cb-e4fd-4d64-89fe-ce444acf7da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.623171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db5cb-e4fd-4d64-89fe-ce444acf7da2 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.623526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db5cb-e4fd-4d64-89fe-ce444acf7da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.623872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db5cb-e4fd-4d64-89fe-ce444acf7da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.633932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6db5cb-e4fd-4d64-89fe-ce444acf7da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.638461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6db5cb-e4fd-4d64-89fe-ce444acf7da2 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.645146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1186/2380] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:17.665092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:17.763382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589be7c-f5d0-47a1-84ed-c3ae3088a5f0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:17.768257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:17.769143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:17.769419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:17.769696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] PATH_INFO: `/v3/users/56794466df98445eac0abf3c612b63d8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:17.771247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56794466df98445eac0abf3c612b63d8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:17.773215 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:17.985836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56794466df98445eac0abf3c612b63d8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:17.995312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56794466df98445eac0abf3c612b63d8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:17.996319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56794466df98445eac0abf3c612b63d8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:17.997415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56794466df98445eac0abf3c612b63d8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.012629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56794466df98445eac0abf3c612b63d8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.095646 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1195/2381] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:17 2022] DELETE /identity/v3/users/56794466df98445eac0abf3c612b63d8 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:18.101129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:18.102127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:18.102449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:18.121932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:18.123193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:18.181062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1187/2382] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:18.194297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:18.194297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:18.252385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac326e-66f9-46de-92ff-2e11c9b89e19 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:18.257425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:18.258080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:18.258402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:18.258679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:18.270090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:18.271657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:18.282066 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1196/2383] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:18.609746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:18.611565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:18.628893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2046d-cc18-4576-8d1e-1bd061eee35d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:18.632308 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:18.633194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:18.633493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:18.633760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] PATH_INFO: `/v3/users/5240eb8155c7445091172dabd10da279` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:18.635493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5240eb8155c7445091172dabd10da279)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:18.637426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:18.757852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:18.759504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:18.774636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce277c-762c-4f20-95a9-f5b1ebf3312a service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:18.779964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:18.780930 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:18.781163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:18.781476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] PATH_INFO: `/v3/projects/f64eac1260384954894c2e5a11b787f7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:18.782764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64eac1260384954894c2e5a11b787f7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:18.784817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:18.858330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5240eb8155c7445091172dabd10da279'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.870899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5240eb8155c7445091172dabd10da279'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.871577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5240eb8155c7445091172dabd10da279'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.878441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5240eb8155c7445091172dabd10da279'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.894486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64eac1260384954894c2e5a11b787f7', 'request_id': 'req-cf561690-b5ed-4242-abe0-390ea250436b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.949380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-36643aa2-ce8d-46eb-9d83-fc326bfe06f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5240eb8155c7445091172dabd10da279'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:18.953802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1188/2384] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:18 2022] DELETE /identity/v3/users/5240eb8155c7445091172dabd10da279 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:19.014621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64eac1260384954894c2e5a11b787f7', 'request_id': 'req-cf561690-b5ed-4242-abe0-390ea250436b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.021874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64eac1260384954894c2e5a11b787f7', 'request_id': 'req-cf561690-b5ed-4242-abe0-390ea250436b'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.036437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] The token cache is being invalidate because project f64eac1260384954894c2e5a11b787f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:19.037506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.037712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-cf561690-b5ed-4242-abe0-390ea250436b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.039265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1197/2385] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:18 2022] DELETE /identity/v3/projects/f64eac1260384954894c2e5a11b787f7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:19.046301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.046641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.046949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.072395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:19.074047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:19.139410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1189/2386] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:19.148172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.148683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.149079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.168363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:19.169681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:19.177620 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1198/2387] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:19.182091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.192003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1691f2-de45-40e2-8708-df39689e55f6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.196561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.197482 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.197762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.198034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.198796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:19.199109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.201496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.213210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1190/2388] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:41:19.217315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.226477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96f513-2e48-43c0-bc84-b8cb3371e6b7 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.231912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.232553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.232830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.233105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.233808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.235790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.263799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.265575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:19.281951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a44dc-b757-4ab2-b8b0-f1666f08c99b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.287064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.288042 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.288195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.288474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] PATH_INFO: `/v3/projects/3c2f3aba9b2f400eb083d419baf62aea` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.289711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2f3aba9b2f400eb083d419baf62aea)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.291863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.360518 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1199/2389] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:19 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:19.364689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.434388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f1346-b0ae-4409-9fda-7cc8847bf9df admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.439134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.439792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.440073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.440349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.441055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.443014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.599300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1200/2390] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:19 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:19.603137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.612844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12975778-4be5-4678-922d-74fc29cf766b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.617552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.618274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.618621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.618971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.619795 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.622540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.638707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1201/2391] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:19.642815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.659926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32fec9-5702-4363-9a51-81a53488012d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.659926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.659926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.659926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.660444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.660444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.661271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.672325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1202/2392] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:19.676577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.680186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2f3aba9b2f400eb083d419baf62aea', 'request_id': 'req-308a13df-dcca-405b-8016-98e3dc1fcc35'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.687528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7a0d5-c8a1-46d8-8706-b156c79bb080 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.759536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c526d4-5dfe-4ea8-8db7-9bfb2445398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.762446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c526d4-5dfe-4ea8-8db7-9bfb2445398a admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.763059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c526d4-5dfe-4ea8-8db7-9bfb2445398a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.763519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c526d4-5dfe-4ea8-8db7-9bfb2445398a admin admin] PATH_INFO: `/v3/projects/29be605e36934c408fe25a661007780b/users/a6e8ab0452b8460db75253d6b0d117e0/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.764418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2f3aba9b2f400eb083d419baf62aea', 'request_id': 'req-308a13df-dcca-405b-8016-98e3dc1fcc35'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.772440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2f3aba9b2f400eb083d419baf62aea', 'request_id': 'req-308a13df-dcca-405b-8016-98e3dc1fcc35'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.782671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c526d4-5dfe-4ea8-8db7-9bfb2445398a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29be605e36934c408fe25a661007780b, user_id=a6e8ab0452b8460db75253d6b0d117e0, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.785827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c526d4-5dfe-4ea8-8db7-9bfb2445398a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.802634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] The token cache is being invalidate because project 3c2f3aba9b2f400eb083d419baf62aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:19.802634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.803123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:19.804752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1191/2393] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:19 2022] DELETE /identity/v3/projects/3c2f3aba9b2f400eb083d419baf62aea => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:19.812498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.813915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:19.828357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a13df-dcca-405b-8016-98e3dc1fcc35 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:19.833296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:19.837445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.837445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.837445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] PATH_INFO: `/v3/users/35f0709568e24d3fa6359e2bc38c3e80` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.837445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f0709568e24d3fa6359e2bc38c3e80)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:19.838662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:19.871097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1203/2394] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:19 2022] PUT /identity/v3/projects/29be605e36934c408fe25a661007780b/users/a6e8ab0452b8460db75253d6b0d117e0/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:19.881858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:19.882147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:19.882453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:19.912219 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] MFA Rules not processed for user `a6e8ab0452b8460db75253d6b0d117e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:19.913448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:19.976733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1204/2395] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:19.981966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:19.983465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:20.053217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f64d18-bf37-4047-96ab-896eca589cc2 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.059028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.059684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.059966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.060238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.060937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.062896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.099191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f0709568e24d3fa6359e2bc38c3e80'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.115525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f0709568e24d3fa6359e2bc38c3e80'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.116176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f0709568e24d3fa6359e2bc38c3e80'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.125445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f0709568e24d3fa6359e2bc38c3e80'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.206498 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1205/2396] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:19 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:20.209841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.227332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f0709568e24d3fa6359e2bc38c3e80'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.234853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1192/2397] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:19 2022] DELETE /identity/v3/users/35f0709568e24d3fa6359e2bc38c3e80 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:20.273836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a62-8689-4a3c-a8ee-385a6bfd5710 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.340594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.341366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.341652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.341980 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.342738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.344683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.491857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1206/2398] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:20 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:20.500550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.500550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:20.513463 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.515685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:20.522423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5444a-7121-4402-be91-0a7fa1914f0e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.533817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65442a72-118f-4170-9f24-7c51fec60040 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.534796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.534796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.534796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.534796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] PATH_INFO: `/v3/projects/94a734a165b148febde15a3fde7ec197` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.536236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a734a165b148febde15a3fde7ec197)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.536893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.537549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.537830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.538102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.538633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.538870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.540510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.552825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1207/2399] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:20.557745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.568050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e15e3-15ba-4360-9bc4-0fc63b9c5ec5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.573403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.574180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.574522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.574797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.575525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.577115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.588170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1208/2400] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:20.592292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.601605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa65b3-c98b-485f-a420-85166cd9c1b4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.606578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9e0d1-07c8-4c19-9211-b58dcc36ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.607448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9e0d1-07c8-4c19-9211-b58dcc36ebde admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.607722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9e0d1-07c8-4c19-9211-b58dcc36ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.607992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9e0d1-07c8-4c19-9211-b58dcc36ebde admin admin] PATH_INFO: `/v3/projects/078ae002e91e479889a0751269e817a3/users/851436e79c714715882454fcc957f0c6/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.624798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9e0d1-07c8-4c19-9211-b58dcc36ebde admin admin] RBAC: Authorizing `identity:create_grant(project_id=078ae002e91e479889a0751269e817a3, user_id=851436e79c714715882454fcc957f0c6, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.627706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9e0d1-07c8-4c19-9211-b58dcc36ebde admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.724394 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1209/2401] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:20 2022] PUT /identity/v3/projects/078ae002e91e479889a0751269e817a3/users/851436e79c714715882454fcc957f0c6/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:20.733336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a734a165b148febde15a3fde7ec197', 'request_id': 'req-425a6e8f-9b5c-4865-96f8-4f79f4659247'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.735337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.736005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.736005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.762233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] MFA Rules not processed for user `851436e79c714715882454fcc957f0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:20.763383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:20.825773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1210/2402] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:20.827157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a734a165b148febde15a3fde7ec197', 'request_id': 'req-425a6e8f-9b5c-4865-96f8-4f79f4659247'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.830323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.833844 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a734a165b148febde15a3fde7ec197', 'request_id': 'req-425a6e8f-9b5c-4865-96f8-4f79f4659247'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.848272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] The token cache is being invalidate because project 94a734a165b148febde15a3fde7ec197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:20.848558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.849218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-425a6e8f-9b5c-4865-96f8-4f79f4659247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:20.856915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1193/2403] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:20 2022] DELETE /identity/v3/projects/94a734a165b148febde15a3fde7ec197 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:20.858389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e88e6-54cf-43ee-a5bc-4f538bd11102 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.858695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e88e6-54cf-43ee-a5bc-4f538bd11102 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.859058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e88e6-54cf-43ee-a5bc-4f538bd11102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.883493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-205e88e6-54cf-43ee-a5bc-4f538bd11102 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:20.885533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-205e88e6-54cf-43ee-a5bc-4f538bd11102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:20.895667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7b26-a06b-410f-ab2a-df6691419424 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.900894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1194/2404] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:20.902416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.902709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.902988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.911786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.912475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.912758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.913031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.913860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.916386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.922416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:20.923619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:20.941822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1195/2405] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:20.946399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.957762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c6e84-bb07-4f97-8141-2dd4691410e6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:20.963597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:20.963597 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:20.963845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:20.964285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:20.964840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:20.965145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:20.966826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:20.979793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1196/2406] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:41:20.984714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:20.996802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f02bd-0402-43f3-9cea-fbbddce8cff6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.002566 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.003225 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.003510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.003783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.004487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.006419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.040206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1211/2407] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:20 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:21.044612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.046260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:21.117809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9966e-9afc-4344-a799-905cfc0e4a79 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.123269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.123931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.124213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.124490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.125190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.127208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.138747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1197/2408] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:20 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:21.143006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.205447 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16f7a-9399-416a-9cfa-1615d8912705 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.211710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.212385 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.213198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.213491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.214446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.216412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.245907 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1212/2409] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:21 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:21.249700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.259967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048a229-17a1-44eb-b6b9-3f180cec3bd0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.264860 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.265583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.265947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.266327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.267127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.268850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.280972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1213/2410] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:21.285232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.299008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fb722-4cd6-4cdb-97c6-7ae1a3f03c04 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.303812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.304706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.304992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.305275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] PATH_INFO: `/v3/projects/8c280054f44c40b39173457329500564/users/6ce25373583b405fa04f9dbbbd2da539/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.320891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c280054f44c40b39173457329500564, user_id=6ce25373583b405fa04f9dbbbd2da539, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.324506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.395073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1198/2411] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:21 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:21.397846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.407478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242ecad-3303-4096-8261-35702ec03c44 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.412111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.412754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.413034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.413307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.414148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.415769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.422837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1214/2412] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:21 2022] PUT /identity/v3/projects/8c280054f44c40b39173457329500564/users/6ce25373583b405fa04f9dbbbd2da539/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:21.427628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1199/2413] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:21.434733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.435055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.444704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f708e-0e76-4ca1-b476-5ad40231a793 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.498580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560705e5-ca40-4f94-ada4-1072682301ae admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.503359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.504027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.504306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.504652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.505306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.506999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.507230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.507903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.508194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.508477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.509226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.512144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.518072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1200/2414] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:21.522201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.530233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1215/2415] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:21.533390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.535369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa288c-b1f3-4678-a642-f731c051692c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.540285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40157e87-2bf2-4da4-b539-812926f4255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.542488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157e87-2bf2-4da4-b539-812926f4255a admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.542703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157e87-2bf2-4da4-b539-812926f4255a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.542984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157e87-2bf2-4da4-b539-812926f4255a admin admin] PATH_INFO: `/v3/projects/a1de7d6cd3a5483292fa95f925271abe/users/53be14e0f5df4a3a8ac0e368deb69012/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.549475 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0424-8464-4ef0-8b0c-178d558b0682 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.555450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c7d9-4bc6-4bf0-a7ae-a835292ee19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.557029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c7d9-4bc6-4bf0-a7ae-a835292ee19d admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.557398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c7d9-4bc6-4bf0-a7ae-a835292ee19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.557774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c7d9-4bc6-4bf0-a7ae-a835292ee19d admin admin] PATH_INFO: `/v3/projects/8c280054f44c40b39173457329500564/users/6ce25373583b405fa04f9dbbbd2da539/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.560056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c7d9-4bc6-4bf0-a7ae-a835292ee19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c280054f44c40b39173457329500564, user_id=6ce25373583b405fa04f9dbbbd2da539, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.563204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c7d9-4bc6-4bf0-a7ae-a835292ee19d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.563889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40157e87-2bf2-4da4-b539-812926f4255a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1de7d6cd3a5483292fa95f925271abe, user_id=53be14e0f5df4a3a8ac0e368deb69012, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.566865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40157e87-2bf2-4da4-b539-812926f4255a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.574901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1216/2416] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:21 2022] PUT /identity/v3/projects/8c280054f44c40b39173457329500564/users/6ce25373583b405fa04f9dbbbd2da539/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:21.586641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.586932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.587208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.614405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] MFA Rules not processed for user `6ce25373583b405fa04f9dbbbd2da539`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:21.615888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:21.658591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1201/2417] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:21 2022] PUT /identity/v3/projects/a1de7d6cd3a5483292fa95f925271abe/users/53be14e0f5df4a3a8ac0e368deb69012/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:21.670335 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c375-973d-4216-8153-09923371cff4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.670629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c375-973d-4216-8153-09923371cff4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.670953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c375-973d-4216-8153-09923371cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.691602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1217/2418] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:21.699560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6786c375-973d-4216-8153-09923371cff4 None None] MFA Rules not processed for user `53be14e0f5df4a3a8ac0e368deb69012`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:21.700799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6786c375-973d-4216-8153-09923371cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:21.702261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.703590 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:21.760986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3a0c-a7c2-4fec-86dc-ea68c0855005 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.772099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1202/2419] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:21.776948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c375-973d-4216-8153-09923371cff4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.814874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.820315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.820315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.820315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.820315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:21.841513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c375-973d-4216-8153-09923371cff4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:21.847216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:21.849985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:21.849985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:21.849985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:21.849985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.851366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.879227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:21.880683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:21.890090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1218/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:21.944006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1203/2421] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:21 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:21.948474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:21.959745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20483f-c8fb-4f38-9952-c2ad5983099c service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.018025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.018727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.019011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.019288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.019994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.022009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:22.125500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1219/2422] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:21 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:22.129590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:22.140274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645e33-ec9e-4fb1-b647-dc0b51f4d117 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.145064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.145751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.146030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.146327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.147091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.148719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:22.161168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1204/2423] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:22.165624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:22.180314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9dbc2-9e4a-4e2e-a029-bb3ad0afa124 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.180753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.182509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.182783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.183055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] PATH_INFO: `/v3/projects/1418fcbd1e994332978010131a5717cf/users/fbe289753518446ab2052563c4a027b8/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.198714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1418fcbd1e994332978010131a5717cf, user_id=fbe289753518446ab2052563c4a027b8, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.202458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:22.341712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1220/2424] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:22 2022] PUT /identity/v3/projects/1418fcbd1e994332978010131a5717cf/users/fbe289753518446ab2052563c4a027b8/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:22.346099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:22.356889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284bb2-dd2d-47fc-93ba-10c4dc989e1e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.417596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e2884-7b00-4bc8-9384-8f904860ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.418411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e2884-7b00-4bc8-9384-8f904860ee78 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.418672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e2884-7b00-4bc8-9384-8f904860ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.418951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e2884-7b00-4bc8-9384-8f904860ee78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.419698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e2884-7b00-4bc8-9384-8f904860ee78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.421327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e2884-7b00-4bc8-9384-8f904860ee78 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:22.437743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1205/2425] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:22.437928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:22.448772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768dcfe-f8a2-4e72-80ed-1101d27f0903 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.453515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.454561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.454838 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.455127 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] PATH_INFO: `/v3/projects/1418fcbd1e994332978010131a5717cf/users/fbe289753518446ab2052563c4a027b8/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.457108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1418fcbd1e994332978010131a5717cf, user_id=fbe289753518446ab2052563c4a027b8, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.459779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:22.470992 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1221/2426] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:22 2022] PUT /identity/v3/projects/1418fcbd1e994332978010131a5717cf/users/fbe289753518446ab2052563c4a027b8/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:22.483338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.484011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.484494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.515388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] MFA Rules not processed for user `fbe289753518446ab2052563c4a027b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:22.516619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:22.590202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1206/2427] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:22.639986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:22.642120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:22.709024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f514-6a04-4cd5-9025-f6749090f453 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.713328 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ee304-18cd-45cb-8b3b-0a9683ca45d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.714094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ee304-18cd-45cb-8b3b-0a9683ca45d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.714340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ee304-18cd-45cb-8b3b-0a9683ca45d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.714615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ee304-18cd-45cb-8b3b-0a9683ca45d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.724256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ee304-18cd-45cb-8b3b-0a9683ca45d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.725781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ee304-18cd-45cb-8b3b-0a9683ca45d2 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:22.737130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1222/2428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:22.825683 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:22.900939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f00ba-c115-40e2-b00e-a543a263451b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:22.905866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:22.906726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:22.907004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:22.907303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] PATH_INFO: `/v3/users/53be14e0f5df4a3a8ac0e368deb69012` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:22.908553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53be14e0f5df4a3a8ac0e368deb69012)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:22.910656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:23.129813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53be14e0f5df4a3a8ac0e368deb69012'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:23.143359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53be14e0f5df4a3a8ac0e368deb69012'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:23.144097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53be14e0f5df4a3a8ac0e368deb69012'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:23.152123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53be14e0f5df4a3a8ac0e368deb69012'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:23.199334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53be14e0f5df4a3a8ac0e368deb69012'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:23.205987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1207/2429] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:22 2022] DELETE /identity/v3/users/53be14e0f5df4a3a8ac0e368deb69012 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:23.210887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:23.211387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:23.211589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:23.230585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:23.231831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:23.292440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1223/2430] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:23.302196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:23.303829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:23.364256 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8960b9-b5c4-4897-b3e3-0cac3981d112 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:23.368086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:23.368727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:23.369544 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:23.369896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:23.379608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:23.381063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:23.391499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1208/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:24.063171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:24.064573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:24.126238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549e43-97e4-4f8c-a719-a3c49fe24c5c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:24.130971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:24.130971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:24.131538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:24.131538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:24.131736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:24.131935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:24.133772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:24.145541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e6d42-c21b-4d67-b233-e01e41efc52d service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:24.151637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:24.152822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:24.153365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:24.153855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] PATH_INFO: `/v3/projects/a1de7d6cd3a5483292fa95f925271abe` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:24.155337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1de7d6cd3a5483292fa95f925271abe)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:24.157964 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:24.207524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:24.208943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:24.218814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1224/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:24.273191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1de7d6cd3a5483292fa95f925271abe', 'request_id': 'req-22404bd0-cc22-476a-a1a1-4eaab85ed440'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.381640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1de7d6cd3a5483292fa95f925271abe', 'request_id': 'req-22404bd0-cc22-476a-a1a1-4eaab85ed440'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.391310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1de7d6cd3a5483292fa95f925271abe', 'request_id': 'req-22404bd0-cc22-476a-a1a1-4eaab85ed440'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.400772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] The token cache is being invalidate because project a1de7d6cd3a5483292fa95f925271abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:24.401007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.401533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.403222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1209/2433] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:24 2022] DELETE /identity/v3/projects/a1de7d6cd3a5483292fa95f925271abe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:24.407240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:24.418702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306366-ffdd-4a64-bcc7-1d8e628c9f46 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:24.494801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:24.495676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:24.495950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:24.496218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] PATH_INFO: `/v3/users/fbe289753518446ab2052563c4a027b8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:24.497472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe289753518446ab2052563c4a027b8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:24.499420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:24.728455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe289753518446ab2052563c4a027b8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.735771 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe289753518446ab2052563c4a027b8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.736525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe289753518446ab2052563c4a027b8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.737144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe289753518446ab2052563c4a027b8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.750957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-32b2d162-c654-4ac9-975c-9ccdfc510e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe289753518446ab2052563c4a027b8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:24.856406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1225/2434] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:24 2022] DELETE /identity/v3/users/fbe289753518446ab2052563c4a027b8 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:25.326236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:25.329810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:25.347463 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404bd0-cc22-476a-a1a1-4eaab85ed440 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:25.409168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:25.410044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:25.410360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:25.410651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] PATH_INFO: `/v3/projects/1418fcbd1e994332978010131a5717cf` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:25.411984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1418fcbd1e994332978010131a5717cf)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:25.413917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:25.559898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1418fcbd1e994332978010131a5717cf', 'request_id': 'req-91d080c1-679b-43d8-ae0c-570c67737b7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:25.627632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1418fcbd1e994332978010131a5717cf', 'request_id': 'req-91d080c1-679b-43d8-ae0c-570c67737b7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:25.633430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1418fcbd1e994332978010131a5717cf', 'request_id': 'req-91d080c1-679b-43d8-ae0c-570c67737b7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:25.644801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] The token cache is being invalidate because project 1418fcbd1e994332978010131a5717cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:25.645085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:25.645715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-91d080c1-679b-43d8-ae0c-570c67737b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:25.647341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1210/2435] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:25 2022] DELETE /identity/v3/projects/1418fcbd1e994332978010131a5717cf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:25.655361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:25.655947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:25.655947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:25.676574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:25.677820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:25.738689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1226/2436] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:25.748508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:25.756868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:25.756868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:25.768766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:25.769970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:25.779286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1211/2437] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:25.794872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:25.804286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fad9-ec57-460d-9869-b93d4e28108c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:25.809887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:25.810643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:25.810945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:25.811244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:25.811983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:25.812286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:25.813885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:25.827594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1227/2438] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:41:25.832048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:25.842233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac040bb-250b-4493-a964-3151a50c6537 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:25.847195 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:25.847851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:25.848131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:25.848408 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:25.849162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:25.851108 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:25.894458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:25.896309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:25.953556 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65f187-cfc6-4e33-a0f2-0bbf9f8c8e84 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:25.957249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:25.957945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:25.958235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:25.958552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:25.960330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:26.022003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1212/2439] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:25 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:26.026130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.027398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.028852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.038623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1228/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:26.087244 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d55f6-9ad9-484e-8586-1df00454e7c7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.092182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.092807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.093193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.093369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.094123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.096041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.192516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1213/2441] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:26 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:26.196827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.207787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5367b9e-83ae-414f-8d27-7a2fc2a41ea4 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.215517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.216659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.217221 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.217643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.218890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.223129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.240332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1229/2442] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:26.244007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.254312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0f46-1257-4700-8381-0625ecee239f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.259092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdcdc7-e7ea-4e57-b772-37852d5a4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.260342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdcdc7-e7ea-4e57-b772-37852d5a4f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.260342 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdcdc7-e7ea-4e57-b772-37852d5a4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.261069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdcdc7-e7ea-4e57-b772-37852d5a4f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.261570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdcdc7-e7ea-4e57-b772-37852d5a4f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.263204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdcdc7-e7ea-4e57-b772-37852d5a4f21 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.276501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1214/2443] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:26.279745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.289657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc1e9d-1a73-4110-a286-58b2c6b23b4a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.294509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.295386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.295720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.296130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] PATH_INFO: `/v3/projects/04773ea0ab72461b80912284c8b0758b/users/b84721d9f11a44489e6dacc18bc8e34c/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.312270 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04773ea0ab72461b80912284c8b0758b, user_id=b84721d9f11a44489e6dacc18bc8e34c, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.314972 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.402724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1230/2444] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:26 2022] PUT /identity/v3/projects/04773ea0ab72461b80912284c8b0758b/users/b84721d9f11a44489e6dacc18bc8e34c/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:26.421653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.422265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.422265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.453799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] MFA Rules not processed for user `b84721d9f11a44489e6dacc18bc8e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:26.455168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:26.524006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1215/2445] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:26.529496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.596588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7e80-31c2-45e0-8f02-5bfd71118f1b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.605378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.606558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.607067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.607578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.608935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.612764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.749454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1231/2446] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:26 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:26.755642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.767525 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00485d-1162-421c-a173-58e5441bb756 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.826068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.826757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.827047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.827313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.828020 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.829958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:26.965923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1216/2447] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:26 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:26.970107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:26.980579 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697686d-b562-4489-9ad8-404f07712aa2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:26.985259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:26.986010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:26.989547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:26.989547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:26.989547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:26.989547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:27.000719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1232/2448] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:27.004879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:27.015358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64438a-289f-4fe9-bc48-4b217af4be37 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:27.020023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:27.020892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.024179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.024179 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] PATH_INFO: `/v3/projects/4e791fc753fe4c238b95a97ba5ae7076/users/d0b504de254b4826a4eba1685f6c4907/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.037299 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e791fc753fe4c238b95a97ba5ae7076, user_id=d0b504de254b4826a4eba1685f6c4907, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:27.040009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:27.123487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1217/2449] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:27 2022] PUT /identity/v3/projects/4e791fc753fe4c238b95a97ba5ae7076/users/d0b504de254b4826a4eba1685f6c4907/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:27.129084 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:27.139876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8adf3b-a1dd-4cd5-87e1-f1e98456f1b5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:27.196348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eb319-76bf-43b3-8c5c-3bab862f1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:27.197017 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eb319-76bf-43b3-8c5c-3bab862f1d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.197887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eb319-76bf-43b3-8c5c-3bab862f1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.198202 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eb319-76bf-43b3-8c5c-3bab862f1d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.199069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eb319-76bf-43b3-8c5c-3bab862f1d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:27.200669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eb319-76bf-43b3-8c5c-3bab862f1d1f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:27.210852 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1233/2450] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:27.215122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:27.225362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f7635-c3bf-40f0-a860-cf129116c24e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:27.230498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:27.231371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.231649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.231945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] PATH_INFO: `/v3/projects/4e791fc753fe4c238b95a97ba5ae7076/users/d0b504de254b4826a4eba1685f6c4907/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.233901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e791fc753fe4c238b95a97ba5ae7076, user_id=d0b504de254b4826a4eba1685f6c4907, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:27.236581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:27.248340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1218/2451] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:27 2022] PUT /identity/v3/projects/4e791fc753fe4c238b95a97ba5ae7076/users/d0b504de254b4826a4eba1685f6c4907/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:27.258621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.258849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.259122 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.286408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] MFA Rules not processed for user `d0b504de254b4826a4eba1685f6c4907`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:27.287684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:27.361839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1234/2452] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:27.372180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:27.373881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:27.433515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ef4c1-8def-4266-a729-8bf8f3e234dd admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:27.437381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620e421-b8af-42ec-ab3e-065ec362ec0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:27.438060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e421-b8af-42ec-ab3e-065ec362ec0a service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.438373 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e421-b8af-42ec-ab3e-065ec362ec0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.438669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620e421-b8af-42ec-ab3e-065ec362ec0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.448897 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e421-b8af-42ec-ab3e-065ec362ec0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:27.450379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620e421-b8af-42ec-ab3e-065ec362ec0a service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:27.461598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1219/2453] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:27.588588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:27.656173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3465d-227e-4bb3-bb37-3b9c65123a32 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:27.661061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:27.661965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.662191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.662494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] PATH_INFO: `/v3/users/b84721d9f11a44489e6dacc18bc8e34c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.663692 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84721d9f11a44489e6dacc18bc8e34c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:27.665611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:27.860154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84721d9f11a44489e6dacc18bc8e34c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:27.869921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84721d9f11a44489e6dacc18bc8e34c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:27.870709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84721d9f11a44489e6dacc18bc8e34c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:27.871325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84721d9f11a44489e6dacc18bc8e34c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:27.885342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84721d9f11a44489e6dacc18bc8e34c'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:27.942400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1235/2454] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:27 2022] DELETE /identity/v3/users/b84721d9f11a44489e6dacc18bc8e34c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:27.948051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:27.948188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:27.948435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:27.970792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:27.972865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:28.033346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1220/2455] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:28.044589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:28.045983 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:28.106552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b5cb2-f322-4d90-a6ca-651ab43028fb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:28.110637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:28.111326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:28.117377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:28.117377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:28.122763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:28.124319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:28.133682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1236/2456] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:28.573807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:28.575888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:28.593607 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381571c-bc8b-45fd-a154-d3d282b0dc35 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:28.599758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:28.600772 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:28.601045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:28.601316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] PATH_INFO: `/v3/projects/04773ea0ab72461b80912284c8b0758b` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:28.602792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04773ea0ab72461b80912284c8b0758b)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:28.604919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:28.761296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04773ea0ab72461b80912284c8b0758b', 'request_id': 'req-0b8e5893-8dca-4a1e-93e6-fe26629264e9'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:28.822794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04773ea0ab72461b80912284c8b0758b', 'request_id': 'req-0b8e5893-8dca-4a1e-93e6-fe26629264e9'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:28.828918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04773ea0ab72461b80912284c8b0758b', 'request_id': 'req-0b8e5893-8dca-4a1e-93e6-fe26629264e9'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:28.839905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] The token cache is being invalidate because project 04773ea0ab72461b80912284c8b0758b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:28.840186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:28.840994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:28.842553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1221/2457] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:28 2022] DELETE /identity/v3/projects/04773ea0ab72461b80912284c8b0758b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:28.846562 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:28.856362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6cb19-ed58-465b-960f-0aa85ffa20a0 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:28.911787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:28.912643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:28.912919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:28.913191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] PATH_INFO: `/v3/users/d0b504de254b4826a4eba1685f6c4907` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:28.914509 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b504de254b4826a4eba1685f6c4907)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:28.916491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:28.933128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:28.935542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:28.949422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5893-8dca-4a1e-93e6-fe26629264e9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:28.954389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:28.955267 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:28.955570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:28.955840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] PATH_INFO: `/v3/users/4f4bcf678ddb4f0099c3950014a94817` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:28.957046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4bcf678ddb4f0099c3950014a94817)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:28.968072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:29.114508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b504de254b4826a4eba1685f6c4907'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.121519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b504de254b4826a4eba1685f6c4907'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.122203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b504de254b4826a4eba1685f6c4907'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.122829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b504de254b4826a4eba1685f6c4907'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.134136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7896daa7-7658-4974-80ab-cd5c853557ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b504de254b4826a4eba1685f6c4907'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.171928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4bcf678ddb4f0099c3950014a94817'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.184032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4bcf678ddb4f0099c3950014a94817'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.184768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4bcf678ddb4f0099c3950014a94817'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.194140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4bcf678ddb4f0099c3950014a94817'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.256293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1237/2458] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:28 2022] DELETE /identity/v3/users/d0b504de254b4826a4eba1685f6c4907 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:29.324822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4bcf678ddb4f0099c3950014a94817'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:29.331440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1222/2459] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:28 2022] DELETE /identity/v3/users/4f4bcf678ddb4f0099c3950014a94817 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:29.335909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:29.336195 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:29.336473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:29.356426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:29.357828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:29.417651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1238/2460] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:29.427422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:29.428853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:29.487298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f204cc-db51-4eae-bf10-6fa34ad96999 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:29.491593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:29.492236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:29.492513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:29.492784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:29.503008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:29.504461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:29.517862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1223/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:29.864846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:29.871115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:29.920471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9863-ba6b-486e-b731-e55cb6d20758 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:29.929193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:29.931207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:29.934676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:29.935420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] PATH_INFO: `/v3/projects/4e791fc753fe4c238b95a97ba5ae7076` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:29.938702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e791fc753fe4c238b95a97ba5ae7076)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:29.944411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.062564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.065513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:30.083337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fb1d8-2860-434c-b793-9ef1272c3d2e service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.103596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.104788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.105046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.105446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] PATH_INFO: `/v3/projects/461c05e73d8c4f928a62c796c018f5f0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.106960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461c05e73d8c4f928a62c796c018f5f0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.109137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.138532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e791fc753fe4c238b95a97ba5ae7076', 'request_id': 'req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.256474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e791fc753fe4c238b95a97ba5ae7076', 'request_id': 'req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.267296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e791fc753fe4c238b95a97ba5ae7076', 'request_id': 'req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.276796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461c05e73d8c4f928a62c796c018f5f0', 'request_id': 'req-f4b6e73e-50ee-4fc4-bc9b-f52330277555'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.281343 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] The token cache is being invalidate because project 4e791fc753fe4c238b95a97ba5ae7076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:30.286357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.286357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-40f80f0d-6c8a-4b8d-8474-7d7b72c64eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.286357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1239/2462] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:29 2022] DELETE /identity/v3/projects/4e791fc753fe4c238b95a97ba5ae7076 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:30.289869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e0de-8921-4f51-ab62-f709e03edc3b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.290161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e0de-8921-4f51-ab62-f709e03edc3b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.290471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e0de-8921-4f51-ab62-f709e03edc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.309565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0ea1e0de-8921-4f51-ab62-f709e03edc3b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:30.310829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0ea1e0de-8921-4f51-ab62-f709e03edc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:30.375026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1240/2463] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:30.383135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461c05e73d8c4f928a62c796c018f5f0', 'request_id': 'req-f4b6e73e-50ee-4fc4-bc9b-f52330277555'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.383337 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.383576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.383856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.390113 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461c05e73d8c4f928a62c796c018f5f0', 'request_id': 'req-f4b6e73e-50ee-4fc4-bc9b-f52330277555'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.402349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] The token cache is being invalidate because project 461c05e73d8c4f928a62c796c018f5f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:30.403010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.403579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:30.404298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:30.405350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1224/2464] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:30 2022] DELETE /identity/v3/projects/461c05e73d8c4f928a62c796c018f5f0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:30.405507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:30.413625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1241/2465] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:30.420039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.430802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6e73e-50ee-4fc4-bc9b-f52330277555 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.436801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.437494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.437766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.438038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.438834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:30.439140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.440796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.454429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1225/2466] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:41:30.459228 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.471034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b833-808f-4b7a-ae24-eddd611cc156 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.476827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.477668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.478020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.478338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.480467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.485824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.587283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1242/2467] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:30 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:30.589007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.598961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e14b-4964-4d6a-9a57-55781636f7c4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.654781 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.655462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.655818 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.656089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.656784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.658726 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.753954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1226/2468] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:30 2022] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:30.758011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.769828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561cb4-3746-4483-8246-1bfcfe6a09a8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.777072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.778234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.778535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.778821 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.779585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.781259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.792989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1243/2469] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:30.797065 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.808012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb3a0f-2261-4a28-b346-46a6c2a1c237 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.812917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65957479-534e-428b-aca0-fc7306d5200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.813657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65957479-534e-428b-aca0-fc7306d5200f admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.813936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65957479-534e-428b-aca0-fc7306d5200f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.814227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65957479-534e-428b-aca0-fc7306d5200f admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.815019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65957479-534e-428b-aca0-fc7306d5200f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.816621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65957479-534e-428b-aca0-fc7306d5200f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.828116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1227/2470] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:30.832380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:30.844617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906fa38-a62c-4179-ad66-0c6c9fc42dad admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:30.850528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:30.851489 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.851807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.852151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] PATH_INFO: `/v3/projects/3408d8835964446aa998cd41a401fd6c/users/2e9501726e65410ab847d23145f30e56/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:30.868531 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3408d8835964446aa998cd41a401fd6c, user_id=2e9501726e65410ab847d23145f30e56, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:30.871242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:30.969605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1244/2471] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:30 2022] PUT /identity/v3/projects/3408d8835964446aa998cd41a401fd6c/users/2e9501726e65410ab847d23145f30e56/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:30.981644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:30.981929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:30.982202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.018549 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] MFA Rules not processed for user `2e9501726e65410ab847d23145f30e56`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:31.019792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.055178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:31.058238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.092410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1228/2472] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:31.121594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:31.123009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.123964 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46b404-ba97-4a62-aa46-38459250d317 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:31.128597 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:31.129515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.129794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.130076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] PATH_INFO: `/v3/users/a6e8ab0452b8460db75253d6b0d117e0` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.131326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e8ab0452b8460db75253d6b0d117e0)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:31.133232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:31.182822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be72662-3600-40a2-8d20-7ba013b6b672 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:31.187048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:31.187697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.187969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.188237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.197901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:31.199560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:31.209331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1229/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:31.224027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:31.235023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b1353-4e2d-4e99-baf9-eb766be4b55e service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:31.240046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:31.240912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.241188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.241462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] PATH_INFO: `/v3/users/2e9501726e65410ab847d23145f30e56` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.242793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9501726e65410ab847d23145f30e56)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:31.245575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:31.384641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e8ab0452b8460db75253d6b0d117e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.392035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e8ab0452b8460db75253d6b0d117e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.392671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e8ab0452b8460db75253d6b0d117e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.393371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e8ab0452b8460db75253d6b0d117e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.406106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-516b0bc2-608f-402a-ab8d-98bfd01826a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e8ab0452b8460db75253d6b0d117e0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.504272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9501726e65410ab847d23145f30e56'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.517028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9501726e65410ab847d23145f30e56'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.517740 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9501726e65410ab847d23145f30e56'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.523825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1245/2474] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:31 2022] DELETE /identity/v3/users/a6e8ab0452b8460db75253d6b0d117e0 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:31.525101 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9501726e65410ab847d23145f30e56'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.529252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.529644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.530248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.548686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:31.549811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.587987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0a652fbb-b70c-4c50-9f2f-db720a31bd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9501726e65410ab847d23145f30e56'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:31.594649 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1230/2475] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:31 2022] DELETE /identity/v3/users/2e9501726e65410ab847d23145f30e56 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:31.599260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.599548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.599854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.609111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1246/2476] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:31.619003 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:31.620050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:31.621287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.621471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.681171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e592eb1-e2de-4b52-bdca-c36a01e2a5be None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:31.682625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1231/2477] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:31.692448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:31.693880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:31.732432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:31.733095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.733376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.733653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.745396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:31.747035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:31.758241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1247/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:31.765953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb7b6a-939b-45e2-814f-070e1f8f4e03 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:31.768418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:31.769095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:31.769368 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:31.769638 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:31.780145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:31.781292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:31.791961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1232/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:32.281740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:32.283279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:32.296976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3333b1-ed4c-459d-86b1-8eb9b484488e service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:32.302281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:32.303261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.303487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.304020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] PATH_INFO: `/v3/projects/29be605e36934c408fe25a661007780b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.305086 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29be605e36934c408fe25a661007780b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:32.307170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:32.324138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:32.325613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:32.354259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559979a0-00d0-4f21-9423-382129f021bb service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:32.360910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:32.361577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.361911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.362185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] PATH_INFO: `/v3/projects/3408d8835964446aa998cd41a401fd6c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.363833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3408d8835964446aa998cd41a401fd6c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:32.365868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:32.495495 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29be605e36934c408fe25a661007780b', 'request_id': 'req-354fed3a-e8c3-4b72-a66f-d8e801b80f84'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.524895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3408d8835964446aa998cd41a401fd6c', 'request_id': 'req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.621809 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29be605e36934c408fe25a661007780b', 'request_id': 'req-354fed3a-e8c3-4b72-a66f-d8e801b80f84'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.628811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29be605e36934c408fe25a661007780b', 'request_id': 'req-354fed3a-e8c3-4b72-a66f-d8e801b80f84'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.639693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] The token cache is being invalidate because project 29be605e36934c408fe25a661007780b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:32.639976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.640612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.642235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1248/2480] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:32 2022] DELETE /identity/v3/projects/29be605e36934c408fe25a661007780b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:32.646187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:32.647573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:32.696144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3408d8835964446aa998cd41a401fd6c', 'request_id': 'req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.703043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3408d8835964446aa998cd41a401fd6c', 'request_id': 'req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.711213 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fed3a-e8c3-4b72-a66f-d8e801b80f84 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:32.714460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] The token cache is being invalidate because project 3408d8835964446aa998cd41a401fd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:32.714750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.715472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-350bdeb4-feb2-4a22-ac16-04fd97a1dfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:32.717141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1233/2481] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:32 2022] DELETE /identity/v3/projects/3408d8835964446aa998cd41a401fd6c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:32.722699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debb3c7-a534-4d74-897b-3d79aa4afee0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.723117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debb3c7-a534-4d74-897b-3d79aa4afee0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.723319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debb3c7-a534-4d74-897b-3d79aa4afee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.741654 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-1debb3c7-a534-4d74-897b-3d79aa4afee0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:32.742882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1debb3c7-a534-4d74-897b-3d79aa4afee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:32.785497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:32.786682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.787137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.787566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] PATH_INFO: `/v3/users/851436e79c714715882454fcc957f0c6` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.789411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=851436e79c714715882454fcc957f0c6)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:32.792336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:32.826521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1234/2482] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:32.832795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.833098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.835312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.858716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:32.860143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:32.871056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1235/2483] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:32.875117 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:32.885072 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fd1a1-7186-44a9-ae32-69d7b31bf76a None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:32.890204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:32.890903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.891185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.891458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.892202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:32.892639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:32.894425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:32.908040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1236/2484] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:41:32.912481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:32.923573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2cd3a-5416-4533-a6e6-bbc4bac42489 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:32.928872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:32.929563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:32.929848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:32.930127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:32.930853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:32.933510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.036300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851436e79c714715882454fcc957f0c6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.044619 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851436e79c714715882454fcc957f0c6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.045487 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851436e79c714715882454fcc957f0c6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.046123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851436e79c714715882454fcc957f0c6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.061581 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1237/2485] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:32 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:41:33.061830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851436e79c714715882454fcc957f0c6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.063551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.065551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:33.131299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1249/2486] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:32 2022] DELETE /identity/v3/users/851436e79c714715882454fcc957f0c6 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:33.136490 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ac4c-51e8-4471-afd5-0e46d6d4e097 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:33.200804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:33.201481 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.201786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.202025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.202784 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:33.204793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.371565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1238/2487] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:33 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:33.376540 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.388369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63c6f0-b470-4319-851c-743db1fcb46b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:33.393096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:33.393764 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.394169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.394477 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.395214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:33.396819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.407629 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1250/2488] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:33.411638 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.421777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3cfb7-9557-4a81-ba8c-b66f4543b8df admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:33.431095 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0c556-4315-4b6d-b45e-43c4e230b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:33.432802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c556-4315-4b6d-b45e-43c4e230b7be admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.433307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c556-4315-4b6d-b45e-43c4e230b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.433583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c556-4315-4b6d-b45e-43c4e230b7be admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.434381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0c556-4315-4b6d-b45e-43c4e230b7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:33.436148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0c556-4315-4b6d-b45e-43c4e230b7be admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.451584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1239/2489] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:33.452854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.464135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21c19f-342d-4f21-a3ec-f6f2ebe044d0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:33.472374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:33.473358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.473716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.474057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] PATH_INFO: `/v3/projects/0f63270caad74d2ab5a02aa80ad08ea1/users/28cce52a599447de8e898b1d42801c7e/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.491956 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f63270caad74d2ab5a02aa80ad08ea1, user_id=28cce52a599447de8e898b1d42801c7e, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:33.495605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.567238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1251/2490] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:33 2022] PUT /identity/v3/projects/0f63270caad74d2ab5a02aa80ad08ea1/users/28cce52a599447de8e898b1d42801c7e/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:33.572418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.572968 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.573412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.591390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:33.592684 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:33.653976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1240/2491] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:33.663645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.665335 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:33.700979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.702427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:33.715778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49ec57-50fa-41aa-bbc0-3e6957795cfa None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:33.722243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:33.723139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.723637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.723913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] PATH_INFO: `/v3/projects/078ae002e91e479889a0751269e817a3` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.725301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078ae002e91e479889a0751269e817a3)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:33.727399 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.733338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841fb6-3269-46c3-9a35-e6aa63db9df9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:33.737815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:33.739813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:33.739813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:33.740308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:33.755742 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:33.757199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:33.767880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1252/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:33.863694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078ae002e91e479889a0751269e817a3', 'request_id': 'req-2ce1e4df-9552-45c8-b7b3-6e2038308682'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.929586 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078ae002e91e479889a0751269e817a3', 'request_id': 'req-2ce1e4df-9552-45c8-b7b3-6e2038308682'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.936152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078ae002e91e479889a0751269e817a3', 'request_id': 'req-2ce1e4df-9552-45c8-b7b3-6e2038308682'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.948437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] The token cache is being invalidate because project 078ae002e91e479889a0751269e817a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:33.949069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.950285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:33.953359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1241/2493] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:33 2022] DELETE /identity/v3/projects/078ae002e91e479889a0751269e817a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:33.959864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:33.971567 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eabd7-32fd-4272-94a9-497653ce2f61 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:34.032679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:34.033546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:34.033824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:34.034096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] PATH_INFO: `/v3/users/6ce25373583b405fa04f9dbbbd2da539` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:34.035332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce25373583b405fa04f9dbbbd2da539)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:34.037232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:34.205750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce25373583b405fa04f9dbbbd2da539'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:34.213616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce25373583b405fa04f9dbbbd2da539'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:34.215618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce25373583b405fa04f9dbbbd2da539'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:34.215618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce25373583b405fa04f9dbbbd2da539'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:34.228488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a21d22b-a124-4341-b000-9d75be1df31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce25373583b405fa04f9dbbbd2da539'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:34.352648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1253/2494] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:33 2022] DELETE /identity/v3/users/6ce25373583b405fa04f9dbbbd2da539 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:34.857925 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:34.859426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:34.873183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1e4df-9552-45c8-b7b3-6e2038308682 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:34.934011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:34.935053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:34.935359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:34.935613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] PATH_INFO: `/v3/projects/8c280054f44c40b39173457329500564` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:34.936874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c280054f44c40b39173457329500564)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:34.938849 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.068916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c280054f44c40b39173457329500564', 'request_id': 'req-b32b00ab-81a5-43cf-96bf-8115022ab998'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:35.164932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c280054f44c40b39173457329500564', 'request_id': 'req-b32b00ab-81a5-43cf-96bf-8115022ab998'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:35.171466 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c280054f44c40b39173457329500564', 'request_id': 'req-b32b00ab-81a5-43cf-96bf-8115022ab998'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:35.183046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] The token cache is being invalidate because project 8c280054f44c40b39173457329500564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:35.183330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:35.183967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b32b00ab-81a5-43cf-96bf-8115022ab998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:35.185573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1242/2495] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:34 2022] DELETE /identity/v3/projects/8c280054f44c40b39173457329500564 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:35.191241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083698e4-ecfb-485d-898c-f02b345a30b9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.191718 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083698e4-ecfb-485d-898c-f02b345a30b9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.191840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083698e4-ecfb-485d-898c-f02b345a30b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.216027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-083698e4-ecfb-485d-898c-f02b345a30b9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:35.219837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-083698e4-ecfb-485d-898c-f02b345a30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:35.269672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.269981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.270252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.300034 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] MFA Rules not processed for user `28cce52a599447de8e898b1d42801c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:35.301516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:35.306107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1254/2496] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:35.315986 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.316182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.316456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.341427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:35.343114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:35.357036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1255/2497] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:35.358349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.370184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326e0f-6ff9-4e89-b841-b7902df47ec1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.375936 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.378255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1243/2498] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:35.379108 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.379754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.380163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.380932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:41:35.381241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.382959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.386872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.388166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:35.399977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1256/2499] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:41:35.401761 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.412584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af0806-b873-4c50-8204-e687055c9de8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.417496 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.418150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.418482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.418729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.419435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.421397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.451019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115daf6-d1ad-4c8a-9ec6-1a402653680d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.455038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.455695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.455977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.456254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.466168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.468688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.480119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1244/2500] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:41:35.511432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1257/2501] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:41:35 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:35.518723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.531320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18112a0b-06c3-4ed8-ab03-bc23df30342f service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.609293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.609899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.610348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.610624 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.611330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.613796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.726132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1245/2502] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:41:35 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:41:35.728198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.739166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb00a-c6fa-45d6-ab91-3861cc34eaac admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.743734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.745249 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.745534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.745804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.746638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.748274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.758658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1258/2503] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:41:35.764750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.774982 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32cff-7d95-47a8-8b28-ff384f9875e7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.780022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc251-bd27-47bf-8125-68bbb71174be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.780697 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc251-bd27-47bf-8125-68bbb71174be admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.780977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc251-bd27-47bf-8125-68bbb71174be admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.781307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc251-bd27-47bf-8125-68bbb71174be admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.782499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc251-bd27-47bf-8125-68bbb71174be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.783719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc251-bd27-47bf-8125-68bbb71174be admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.795199 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1246/2504] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:41:35.799332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:35.810308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b81d15-c8e3-4dd4-a3fb-83e0674bc1f8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:35.816418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:35.818912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.818912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.818912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] PATH_INFO: `/v3/projects/6b5b54830ae04c439e2823aa280b9f7f/users/1da19537521f4f94ab14f8d690abddcf/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.835684 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5b54830ae04c439e2823aa280b9f7f, user_id=1da19537521f4f94ab14f8d690abddcf, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:35.838864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:35.923789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1259/2505] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:41:35 2022] PUT /identity/v3/projects/6b5b54830ae04c439e2823aa280b9f7f/users/1da19537521f4f94ab14f8d690abddcf/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:41:35.934930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e534ade-2a65-4296-9e16-5312863261b9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:35.935521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e534ade-2a65-4296-9e16-5312863261b9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:35.935521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e534ade-2a65-4296-9e16-5312863261b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:35.965298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0e534ade-2a65-4296-9e16-5312863261b9 None None] MFA Rules not processed for user `1da19537521f4f94ab14f8d690abddcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:35.966587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0e534ade-2a65-4296-9e16-5312863261b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:36.034435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1247/2506] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:36.044214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:36.045952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:36.110034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdf45f-15be-4dbd-b3ab-e31012b50f50 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:36.115237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c001-341b-431b-8587-c2abf948ab18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:36.115984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c001-341b-431b-8587-c2abf948ab18 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:36.132023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c001-341b-431b-8587-c2abf948ab18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:36.132023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c001-341b-431b-8587-c2abf948ab18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:36.132023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c001-341b-431b-8587-c2abf948ab18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:36.132023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c001-341b-431b-8587-c2abf948ab18 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:36.139537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1260/2507] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:37.232542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:37.233679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:37.234132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:37.266905 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] MFA Rules not processed for user `28cce52a599447de8e898b1d42801c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:37.268496 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:37.334462 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1248/2508] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:42.952374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cc71a-0c7a-4a2d-a1b6-2b7b45d02389 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:42.952919 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cc71a-0c7a-4a2d-a1b6-2b7b45d02389 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:42.953405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cc71a-0c7a-4a2d-a1b6-2b7b45d02389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:42.981022 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5d4cc71a-0c7a-4a2d-a1b6-2b7b45d02389 None None] MFA Rules not processed for user `2c652557dbd54165a3498c08b2dd5673`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:42.983305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5d4cc71a-0c7a-4a2d-a1b6-2b7b45d02389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:43.044036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1261/2509] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:41:57.723819 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:57.786133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce24c4e-cd26-4a63-9d0e-4a5f8d88b055 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:57.793052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:57.793052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:57.793052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:57.793052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] PATH_INFO: `/v3/users/1da19537521f4f94ab14f8d690abddcf` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:57.793673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da19537521f4f94ab14f8d690abddcf)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:57.795721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:58.097693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da19537521f4f94ab14f8d690abddcf'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:58.112546 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da19537521f4f94ab14f8d690abddcf'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:58.113383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da19537521f4f94ab14f8d690abddcf'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:58.124207 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da19537521f4f94ab14f8d690abddcf'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:58.184211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da19537521f4f94ab14f8d690abddcf'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:58.190881 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1249/2510] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:41:57 2022] DELETE /identity/v3/users/1da19537521f4f94ab14f8d690abddcf => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:41:58.195582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:58.196126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:58.196126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:58.220895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:41:58.223037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:58.294205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1262/2511] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:41:58.305057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:58.306527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:58.425792 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6026c-b546-4897-a5d1-2357fdb693cc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:58.429690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a2cfa-e185-463a-85b7-4dcd09d494d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:58.430468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a2cfa-e185-463a-85b7-4dcd09d494d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:58.430862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a2cfa-e185-463a-85b7-4dcd09d494d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:58.431213 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a2cfa-e185-463a-85b7-4dcd09d494d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:58.441486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a2cfa-e185-463a-85b7-4dcd09d494d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:58.443007 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a2cfa-e185-463a-85b7-4dcd09d494d9 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:58.455084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1250/2512] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:41:58.898917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:41:58.900311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:41:58.912411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080db73-266b-41ac-9d40-372d00e719d2 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:41:58.918583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:41:58.920754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:41:58.920754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:41:58.920754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] PATH_INFO: `/v3/projects/6b5b54830ae04c439e2823aa280b9f7f` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:41:58.921826 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5b54830ae04c439e2823aa280b9f7f)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:41:58.924055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:41:59.065061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5b54830ae04c439e2823aa280b9f7f', 'request_id': 'req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:59.132190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5b54830ae04c439e2823aa280b9f7f', 'request_id': 'req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:59.139845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5b54830ae04c439e2823aa280b9f7f', 'request_id': 'req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:59.150121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] The token cache is being invalidate because project 6b5b54830ae04c439e2823aa280b9f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:41:59.150580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:59.151861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-e9ad1a77-7c1b-4de7-967d-a99cfe4f10e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:41:59.153448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1263/2513] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:41:58 2022] DELETE /identity/v3/projects/6b5b54830ae04c439e2823aa280b9f7f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:42:01.888443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2a84-b9c2-4f36-847e-3cdaffcce957 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:01.889009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2a84-b9c2-4f36-847e-3cdaffcce957 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:01.889009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2a84-b9c2-4f36-847e-3cdaffcce957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:01.906235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-61eb2a84-b9c2-4f36-847e-3cdaffcce957 None None] MFA Rules not processed for user `28cce52a599447de8e898b1d42801c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:01.907520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-61eb2a84-b9c2-4f36-847e-3cdaffcce957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:01.962820 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1251/2514] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:42:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:22.997724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:22.998286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:22.998386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:23.016706 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] MFA Rules not processed for user `0a3ea138daa84701bbf756e1ec43fb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:23.022587 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:23.072738 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1264/2515] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:42:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:24.860643 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:24.861621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:24.862824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:24.885171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:24.887369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:24.953320 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1252/2516] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:42:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:25.108655 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:25.110120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:25.180089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec307bd-0147-44a6-97f5-520c58edee63 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:25.185780 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:25.186693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:25.187085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:25.187366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:25.196214 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:25.197897 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:25.207789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1265/2517] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:42:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:42:29.640948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:29.642416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:29.717389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88724f-49c9-40fe-8e49-75ba024f9481 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:29.721365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:29.722019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:29.722325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:29.722601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:29.724420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:29.810498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:29.812128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:29.826634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1253/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:42:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:42:34.764119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:34.778295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb3b09-5999-452d-a78f-dfc34c16fb7e service swift] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:34.782453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:34.783283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:34.783572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:34.783849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:34.785802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:34.800772 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:34.802275 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac57db9-0d98-46e0-8991-3e584a7544ca service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:34.815471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1266/2519] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:42:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:42:39.546062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:39.547713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:39.567084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9104-9947-4c8f-bc67-95e4b98c6706 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:39.577689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:39.578386 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:39.578665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:39.578941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:39.580796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:39.676363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:39.678378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:39.705878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1254/2520] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:42:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:42:43.813617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:43.814201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:43.814201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:43.832796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:43.834023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:43.842569 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1267/2521] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jan 10 11:42:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:43.855669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:43.867585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3b44c-abef-4b15-ad2e-4c1b33de0228 service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:43.872815 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:43.873456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:43.873733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:43.874006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:43.882307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:43.883885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:43.891866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1255/2522] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:42:44.614616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:44.628072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e66a7-d105-4392-aad6-fdb090fb638e None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:44.633521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:44.634160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:44.634469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:44.634794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:44.637811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:44.649274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:44.651925 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:44.662599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1268/2523] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:42:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:42:47.186298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:47.188465 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:47.253914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83950fc2-4f2d-4a49-bfd4-fbc89a6e9397 service swift] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:47.258489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:47.263158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:47.263158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:47.263158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] PATH_INFO: `/v3/users/28cce52a599447de8e898b1d42801c7e` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:47.263158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cce52a599447de8e898b1d42801c7e)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:47.263158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:47.479394 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cce52a599447de8e898b1d42801c7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:47.492584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cce52a599447de8e898b1d42801c7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:47.493324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cce52a599447de8e898b1d42801c7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:47.500783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cce52a599447de8e898b1d42801c7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:47.577980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a9908cb8-3ccd-43c4-91a3-975d1e2673e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cce52a599447de8e898b1d42801c7e'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:47.584437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1256/2524] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:42:47 2022] DELETE /identity/v3/users/28cce52a599447de8e898b1d42801c7e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:42:47.845087 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:47.856222 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed4d47-98af-4561-bb53-59143036c351 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:47.914401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:47.915257 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:47.915541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:47.915807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] PATH_INFO: `/v3/projects/0f63270caad74d2ab5a02aa80ad08ea1` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:47.916996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f63270caad74d2ab5a02aa80ad08ea1)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:47.918976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.018395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f63270caad74d2ab5a02aa80ad08ea1', 'request_id': 'req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:48.099855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f63270caad74d2ab5a02aa80ad08ea1', 'request_id': 'req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:48.108058 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f63270caad74d2ab5a02aa80ad08ea1', 'request_id': 'req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:48.120254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] The token cache is being invalidate because project 0f63270caad74d2ab5a02aa80ad08ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:42:48.120534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:48.121194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7bdcfa8d-09bb-483b-a3fc-2a17595e86f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:42:48.122750 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1269/2525] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:42:47 2022] DELETE /identity/v3/projects/0f63270caad74d2ab5a02aa80ad08ea1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:42:48.130261 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.130558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.130871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.148853 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:48.150082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:48.208331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1257/2526] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:48.217478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.217804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.218236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.236863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:48.238062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:48.246566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1270/2527] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:48.250762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.260210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03c4cb-1683-476b-a50d-d0986e73eda0 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:48.265339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:48.265997 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.266309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.266588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.267327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:42:48.267664 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:48.269289 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.281293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1258/2528] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:42:48.291876 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.305429 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb3caf-c090-41ea-aa8a-0d22ffa16ae9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:48.310194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:48.310872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.311149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.311423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.312129 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:48.314020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.432371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1271/2529] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:42:48 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:42:48.437739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.448426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf72ce-5095-4599-8336-b3ea14f77411 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:48.506123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:48.506965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.507102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.507378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.508091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:48.510017 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.646813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1259/2530] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:42:48 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:42:48.651135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.663349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4e887-2cc6-40fd-8990-857311afc362 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:48.668800 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:48.674026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.674026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.674026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.674026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:48.674026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.683378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1272/2531] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:42:48.688092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.698275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48347826-b0e1-470c-acf9-d05c19ccecd5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:48.703662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014f8be-e4ea-49d9-a29e-19bc9a585558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:48.704326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014f8be-e4ea-49d9-a29e-19bc9a585558 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.704603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014f8be-e4ea-49d9-a29e-19bc9a585558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.704873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014f8be-e4ea-49d9-a29e-19bc9a585558 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.705602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014f8be-e4ea-49d9-a29e-19bc9a585558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:48.707233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014f8be-e4ea-49d9-a29e-19bc9a585558 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.719435 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1260/2532] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:42:48.723641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.734928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114f83-93fc-409d-9340-08449f505ee9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:48.739583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:48.740452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.740987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.741260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] PATH_INFO: `/v3/projects/e45c180d632e41cdb97880086d7705c2/users/54f31a023173496e977e99bbc0eb6b8b/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.756561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45c180d632e41cdb97880086d7705c2, user_id=54f31a023173496e977e99bbc0eb6b8b, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:48.759677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:48.894827 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1273/2533] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:42:48 2022] PUT /identity/v3/projects/e45c180d632e41cdb97880086d7705c2/users/54f31a023173496e977e99bbc0eb6b8b/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:42:48.905009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac14b7-958b-4585-b76d-bd0a5774394b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:48.905309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac14b7-958b-4585-b76d-bd0a5774394b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:48.905672 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac14b7-958b-4585-b76d-bd0a5774394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:48.923456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-15ac14b7-958b-4585-b76d-bd0a5774394b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:48.924651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-15ac14b7-958b-4585-b76d-bd0a5774394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:48.981673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1261/2534] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:48.991505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:48.993226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:49.052723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbe57b-cf28-4c39-a8f9-5e8ca0ddca41 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:49.056458 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:49.057096 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:49.057377 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:49.057653 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:49.067471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:49.068908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:49.079536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1274/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:42:54.948270 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:54.948865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:54.948865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:54.978345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] MFA Rules not processed for user `54f31a023173496e977e99bbc0eb6b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:42:54.979587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:42:55.055008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1262/2536] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:42:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:42:55.060296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:55.070198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7496-ee77-42fd-b470-f4860669a0cb service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:55.076491 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:55.077385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:55.077815 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:55.078271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:55.079254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:55.081691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:55.197981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1275/2537] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:42:55 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:42:55.202635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:55.217084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e13f6-5437-4f53-8591-576093b7d86d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:55.281995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:55.282746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:55.283027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:55.283324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:55.284032 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:55.286148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:55.369252 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1263/2538] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:42:55 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:42:55.373527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:55.389397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe91ff9-3258-435c-b9b0-24825275f3b9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:55.394201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:55.394910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:55.395188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:55.395461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:55.396198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:55.397806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:55.409376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1276/2539] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:42:55.413820 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:55.425105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a68a82-ab00-45ff-b757-75c5c342e743 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:55.429808 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:55.430704 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:55.430978 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:55.431245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] PATH_INFO: `/v3/projects/a00e0863a4a9437aad4c9fae5ecc92c8/users/e95a39786f414c7797d2fdb55cb78c64/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:55.446694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00e0863a4a9437aad4c9fae5ecc92c8, user_id=e95a39786f414c7797d2fdb55cb78c64, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:55.449895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:55.541795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1264/2540] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:42:55 2022] PUT /identity/v3/projects/a00e0863a4a9437aad4c9fae5ecc92c8/users/e95a39786f414c7797d2fdb55cb78c64/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:42:55.545965 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:55.555923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7abf2-bc9c-4511-a2b1-57441c16ec1a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:55.609342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4d9c7-4f08-441a-97d1-7a9f01b26de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:55.609998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4d9c7-4f08-441a-97d1-7a9f01b26de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:55.610313 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4d9c7-4f08-441a-97d1-7a9f01b26de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:55.610594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4d9c7-4f08-441a-97d1-7a9f01b26de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:55.611324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4d9c7-4f08-441a-97d1-7a9f01b26de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:55.612946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4d9c7-4f08-441a-97d1-7a9f01b26de6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:55.623612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1277/2541] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:42:55.627766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:42:55.638520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e0238-82ad-47c0-9dd8-9f9f35af241e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:42:55.643194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:42:55.644011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:42:55.644298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:42:55.644570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] PATH_INFO: `/v3/projects/a00e0863a4a9437aad4c9fae5ecc92c8/users/e95a39786f414c7797d2fdb55cb78c64/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:42:55.646571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00e0863a4a9437aad4c9fae5ecc92c8, user_id=e95a39786f414c7797d2fdb55cb78c64, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:42:55.649655 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:42:55.661292 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1265/2542] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:42:55 2022] PUT /identity/v3/projects/a00e0863a4a9437aad4c9fae5ecc92c8/users/e95a39786f414c7797d2fdb55cb78c64/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:43:00.618922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305dd65-8192-43fa-9df0-ce87d0344ded None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:00.622440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305dd65-8192-43fa-9df0-ce87d0344ded None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:00.622440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305dd65-8192-43fa-9df0-ce87d0344ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:00.638763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d305dd65-8192-43fa-9df0-ce87d0344ded None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:00.640005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d305dd65-8192-43fa-9df0-ce87d0344ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:00.702271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1278/2543] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:43:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:00.716046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:00.718057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:00.827491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7173bb5-06c0-4f13-943b-4451bd71195e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:00.833312 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:00.836588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:00.837041 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:00.837483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:00.851922 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:00.854436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:00.869752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1266/2544] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:43:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:43:02.196960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28d25-371e-4cde-890c-624c017e584c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:02.214912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28d25-371e-4cde-890c-624c017e584c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:02.214912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28d25-371e-4cde-890c-624c017e584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:02.249073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-86d28d25-371e-4cde-890c-624c017e584c None None] MFA Rules not processed for user `e95a39786f414c7797d2fdb55cb78c64`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:02.250891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-86d28d25-371e-4cde-890c-624c017e584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:02.378541 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1279/2545] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:43:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:02.397928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:02.401422 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:02.605936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be7cb9-f3b6-44c5-ac8b-a42f47880e75 service swift] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:02.618254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:02.619067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:02.619590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:02.619976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:02.739747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:02.741826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:02.772620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1267/2546] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:03.052288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:03.052510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:03.053049 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:03.095967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:03.097469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:03.107140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1280/2547] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:43:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:03.123625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:03.138260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc83cd-eed0-4f0d-ba0a-2acaf38d7a5c service glance] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:03.144743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aa04b-00ff-4139-b28d-1907534bbdee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:03.145440 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa04b-00ff-4139-b28d-1907534bbdee service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:03.145721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa04b-00ff-4139-b28d-1907534bbdee service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:03.146002 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa04b-00ff-4139-b28d-1907534bbdee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:03.159661 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aa04b-00ff-4139-b28d-1907534bbdee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:03.161318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aa04b-00ff-4139-b28d-1907534bbdee service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:03.173560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1268/2548] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:43:16.254107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:16.255563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:16.312230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0068de-a007-480a-adf1-a7e7115ea55a None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:16.315875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:16.316534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:16.316880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:16.317089 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:16.318858 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:16.328686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:16.336057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:16.338030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1281/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:16.640987 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:16.641582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:16.641582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:16.666304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] MFA Rules not processed for user `54f31a023173496e977e99bbc0eb6b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:16.667516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:16.675345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1269/2550] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:43:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:43:17.014229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:17.022610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972119d-1923-44c4-ad08-549ce2723038 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:17.026250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:17.026870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:17.027147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:17.027418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:17.029903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:17.039346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:17.040793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:17.048985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1282/2551] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:17.459706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:17.463418 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:17.539952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e96e59-5336-4985-9e61-f0b68f9cbd1b None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:17.545363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:17.545999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:17.546313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:17.546594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:17.548387 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:17.560269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:17.561872 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37857-5c05-4ee3-9bc0-e11a9feeec4d service placement] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:17.571609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1270/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:20.118069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:20.119565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:20.203462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae44a1-4897-40e6-851e-9b7cd9d2ae8a service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:20.210048 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:20.210792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:20.211082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:20.211357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:20.213150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:20.230510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:20.232327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:20.249633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1283/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:20.947884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115904b6-d856-4a15-8095-ffde73402b9e None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:20.948433 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115904b6-d856-4a15-8095-ffde73402b9e None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:20.948535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115904b6-d856-4a15-8095-ffde73402b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:20.968868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-115904b6-d856-4a15-8095-ffde73402b9e None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:20.970012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-115904b6-d856-4a15-8095-ffde73402b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:20.977543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1271/2554] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:43:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:20.991811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:21.006478 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704399c3-6b31-441d-a7ae-0faa4ded4f57 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:21.011724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fadace-b6d3-4041-93ad-9f25df88abd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:21.012885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadace-b6d3-4041-93ad-9f25df88abd7 service swift] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:21.013798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadace-b6d3-4041-93ad-9f25df88abd7 service swift] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:21.014075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fadace-b6d3-4041-93ad-9f25df88abd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:21.022927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fadace-b6d3-4041-93ad-9f25df88abd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:21.024538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fadace-b6d3-4041-93ad-9f25df88abd7 service swift] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:21.034131 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1284/2555] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:43:22.075274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6b923-2b73-489f-9b23-c26e0fc86885 None None] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:22.075783 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6b923-2b73-489f-9b23-c26e0fc86885 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:22.075893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6b923-2b73-489f-9b23-c26e0fc86885 None None] PATH_INFO: `/` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:22.078036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1272/2556] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:43:22.084346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea184d-0082-4ec0-84d8-ef511218c48b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:22.104232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea184d-0082-4ec0-84d8-ef511218c48b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:22.104232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea184d-0082-4ec0-84d8-ef511218c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:22.104232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4bea184d-0082-4ec0-84d8-ef511218c48b None None] MFA Rules not processed for user `df05886e51f34628a524477b98227f40`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:22.105712 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4bea184d-0082-4ec0-84d8-ef511218c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:22.117479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1285/2557] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:43:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:22.133484 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6b923-2b73-489f-9b23-c26e0fc86885 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:22.135499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-bcd6b923-2b73-489f-9b23-c26e0fc86885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:22.152494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6b923-2b73-489f-9b23-c26e0fc86885 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:22.166946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aab6e-7128-44d9-9fec-fe2f97a69205 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a45f34ca2b48e1ad61d3064715625f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:22.168246 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aab6e-7128-44d9-9fec-fe2f97a69205 service glance] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:22.169457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aab6e-7128-44d9-9fec-fe2f97a69205 service glance] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:22.170029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aab6e-7128-44d9-9fec-fe2f97a69205 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:22.186457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aab6e-7128-44d9-9fec-fe2f97a69205 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:22.188067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aab6e-7128-44d9-9fec-fe2f97a69205 service glance] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:22.201375 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1273/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:22.577423 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ff93-c264-4a3d-a83a-f97c33b01b7b None None] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:22.577763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ff93-c264-4a3d-a83a-f97c33b01b7b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:22.577994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ff93-c264-4a3d-a83a-f97c33b01b7b None None] PATH_INFO: `/` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:22.579805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1286/2559] 10.222.0.20 () {54 vars in 921 bytes} [Mon Jan 10 11:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 11:43:22.584941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:22.585233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:22.585534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:22.610892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] MFA Rules not processed for user `dd7492ffb2a543979f94421c2649e5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:22.613191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:22.632429 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1274/2560] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Jan 10 11:43:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:22.645701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ff93-c264-4a3d-a83a-f97c33b01b7b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:22.660469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ff93-c264-4a3d-a83a-f97c33b01b7b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:22.667519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4a7ba-d567-4a49-9a32-5e6afdf40c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:22.668984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a7ba-d567-4a49-9a32-5e6afdf40c7c service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:22.669776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a7ba-d567-4a49-9a32-5e6afdf40c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:22.670552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4a7ba-d567-4a49-9a32-5e6afdf40c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:22.683476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a7ba-d567-4a49-9a32-5e6afdf40c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:22.686438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4a7ba-d567-4a49-9a32-5e6afdf40c7c service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:22.714308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1287/2561] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:31.280290 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:31.291467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:31.328807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a123-e0d7-4120-91dc-3ede76579564 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:31.336076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:31.337059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:31.337343 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:31.337622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:31.339563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:31.355062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:31.359235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:31.390098 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1275/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:43:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:43:32.713090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b071f-7b9f-4f27-b625-743209361ec6 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:32.713677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b071f-7b9f-4f27-b625-743209361ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:32.713677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b071f-7b9f-4f27-b625-743209361ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:32.737308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-768b071f-7b9f-4f27-b625-743209361ec6 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:32.738581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-768b071f-7b9f-4f27-b625-743209361ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:32.747286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1288/2563] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Jan 10 11:43:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:43:32.781486 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:32.797160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a018920-7398-4afa-bac6-2b3b37ec96a4 service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:32.806374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:32.807131 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:32.807626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:32.808659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:32.820219 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:32.822425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:32.838562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1276/2564] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:43:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:43:47.855536 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:47.856097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:47.856097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:47.874985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:43:47.876245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:43:47.883818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1289/2565] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jan 10 11:43:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:43:47.898326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:43:47.910956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e500395-372f-4cda-9c24-b76331735664 service swift] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:43:47.919079 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:43:47.920315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:43:47.920603 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:43:47.920883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:43:47.929943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:43:47.932505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:43:47.944797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1277/2566] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:01.643172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:01.652295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0814846-3808-45be-9eb9-f9bfab1d7741 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:01.656497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:01.657128 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:01.657410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:01.657685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:01.666988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:01.668331 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:01.678773 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1290/2567] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:03.947514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:03.965087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ecf8c-ab07-4680-933d-6b88e9d12b4e service swift] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:03.973870 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:03.974827 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:03.975171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:03.975498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:03.977926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:03.993579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:03.995773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:04.008728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1278/2568] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:14.229034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:14.237600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f10e9-55cf-4856-88ed-dcc05f133b46 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:14.241563 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:14.242192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:14.242505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:14.242776 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:14.244807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:14.306315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:14.307814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:14.318244 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1291/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:18.288163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:18.291388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:18.304008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1445-b799-4a67-b323-6a956f0063fe service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:18.308980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:18.309866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:18.310146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:18.311331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] PATH_INFO: `/v3/users/0a3ea138daa84701bbf756e1ec43fb4c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:18.312647 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3ea138daa84701bbf756e1ec43fb4c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:18.314608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:18.511516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3ea138daa84701bbf756e1ec43fb4c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:18.524050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3ea138daa84701bbf756e1ec43fb4c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:18.524775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3ea138daa84701bbf756e1ec43fb4c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:18.532123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3ea138daa84701bbf756e1ec43fb4c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:18.604641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3231fa5d-f863-409f-b66d-96a133cac092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3ea138daa84701bbf756e1ec43fb4c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:18.611415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1279/2570] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:18 2022] DELETE /identity/v3/users/0a3ea138daa84701bbf756e1ec43fb4c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:18.881988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:18.894336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8411-97e9-4777-88dc-e2c1f27232d4 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:18.968160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:18.969021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:18.969315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:18.969570 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] PATH_INFO: `/v3/projects/f8635cce808f4b1c9e754fe407a2f60b` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:18.970828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8635cce808f4b1c9e754fe407a2f60b)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:18.972740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.109682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8635cce808f4b1c9e754fe407a2f60b', 'request_id': 'req-96e676f1-5d97-443f-a333-13110c6fce41'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:19.193146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8635cce808f4b1c9e754fe407a2f60b', 'request_id': 'req-96e676f1-5d97-443f-a333-13110c6fce41'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:19.199994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8635cce808f4b1c9e754fe407a2f60b', 'request_id': 'req-96e676f1-5d97-443f-a333-13110c6fce41'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:19.211660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] The token cache is being invalidate because project f8635cce808f4b1c9e754fe407a2f60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:19.212173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:19.212591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-96e676f1-5d97-443f-a333-13110c6fce41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:19.214147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1292/2571] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:18 2022] DELETE /identity/v3/projects/f8635cce808f4b1c9e754fe407a2f60b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:19.220088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.225381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.225381 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.239082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:19.240304 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:19.323640 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1280/2572] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:19.332174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.332462 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.332737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.351408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:19.352782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:19.362867 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1293/2573] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:19.368038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:19.380916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864ab43-f069-4931-a9b8-ecd08ffd2f56 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:19.385592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:19.386293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.386577 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.386852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.387593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:44:19.387898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:19.390198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.407633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1281/2574] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:44:19.412460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:19.422726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777583cc-b4d9-41e3-8235-295a23c4d971 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:19.427436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:19.428092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.428376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.428648 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.429369 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:19.431348 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.535037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1294/2575] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:19 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:44:19.539479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:19.549334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a44bc3-7c7f-467f-8a85-e69dc1455491 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:19.606941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:19.607846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.608278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.608562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.609303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:19.611265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.698166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1282/2576] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:19 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:19.702990 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:19.714879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189d2fe-c265-4664-948d-bd90947ac275 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:19.719714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:19.720360 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.720637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.720905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.721637 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:19.723299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.733952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1295/2577] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:19.737967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:19.755509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f871db-9462-4048-97ce-d02f9951506f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:19.760847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0aa64-5e58-4e8f-9bea-3fb64a5d0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:19.761502 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0aa64-5e58-4e8f-9bea-3fb64a5d0edf admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.761775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0aa64-5e58-4e8f-9bea-3fb64a5d0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.762044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0aa64-5e58-4e8f-9bea-3fb64a5d0edf admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.762880 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0aa64-5e58-4e8f-9bea-3fb64a5d0edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:19.765268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0aa64-5e58-4e8f-9bea-3fb64a5d0edf admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.776200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1283/2578] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:19.781076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:19.791238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89dc4-064a-4218-baf7-757c6cbcd1e3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:19.796200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:19.797062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.797338 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.797608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] PATH_INFO: `/v3/projects/c5821d97cc794bd3a7c425e8a1f3d580/users/7e552e09ff564a1ea401c04ab84bf1ae/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.814327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5821d97cc794bd3a7c425e8a1f3d580, user_id=7e552e09ff564a1ea401c04ab84bf1ae, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:19.816999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:19.904303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1296/2579] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:19 2022] PUT /identity/v3/projects/c5821d97cc794bd3a7c425e8a1f3d580/users/7e552e09ff564a1ea401c04ab84bf1ae/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:19.914620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:19.914954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:19.915228 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:19.942470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] MFA Rules not processed for user `7e552e09ff564a1ea401c04ab84bf1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:19.943688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:20.007766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1284/2580] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:20.012419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.074320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3a25-7a54-4ec3-9a39-d5499b1e4e2f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.079242 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.079894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.080182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.080460 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.081170 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.083098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.191329 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1297/2581] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:20 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:20.195641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.207174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2d769-f080-40d5-aa97-ad868ae107f3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.264115 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.264879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.265162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.265437 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.266154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.268173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.368793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1285/2582] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:20 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:20.373306 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.383866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bab9f-ce01-430b-98d2-17a16cbed290 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.388474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.389770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.390131 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.390444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.391182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.392787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.403989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1298/2583] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:20.415470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.426259 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ab87c-3864-4d77-96f3-839113a166fe admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.431801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.432894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.433178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.433518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] PATH_INFO: `/v3/projects/bc763c6b0d314d2faf881932dc1a43c7/users/4e48fb0dccdf4a06a7a410bb0b98908d/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.450698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc763c6b0d314d2faf881932dc1a43c7, user_id=4e48fb0dccdf4a06a7a410bb0b98908d, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.454050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.538203 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1286/2584] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:20 2022] PUT /identity/v3/projects/bc763c6b0d314d2faf881932dc1a43c7/users/4e48fb0dccdf4a06a7a410bb0b98908d/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:44:20.538586 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.547594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45177a9-237a-431f-b44e-30c753a61a29 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.607157 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb1c77-d165-4de4-84be-57792f6d0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.608167 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb1c77-d165-4de4-84be-57792f6d0df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.608488 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb1c77-d165-4de4-84be-57792f6d0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.608856 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb1c77-d165-4de4-84be-57792f6d0df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.609577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb1c77-d165-4de4-84be-57792f6d0df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.611225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb1c77-d165-4de4-84be-57792f6d0df7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.621565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1299/2585] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:20.626727 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.637086 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae3903-6e44-4de2-b26f-b0c6fea43cf4 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.643588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.644529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.644848 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.645167 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] PATH_INFO: `/v3/projects/bc763c6b0d314d2faf881932dc1a43c7/users/4e48fb0dccdf4a06a7a410bb0b98908d/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.647380 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc763c6b0d314d2faf881932dc1a43c7, user_id=4e48fb0dccdf4a06a7a410bb0b98908d, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.650119 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.661468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1287/2586] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:20 2022] PUT /identity/v3/projects/bc763c6b0d314d2faf881932dc1a43c7/users/4e48fb0dccdf4a06a7a410bb0b98908d/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:20.673324 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.673616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.673895 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.703139 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] MFA Rules not processed for user `4e48fb0dccdf4a06a7a410bb0b98908d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:20.704387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:20.777182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1300/2587] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:44:20.787675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:20.789416 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:20.854768 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b5873-5719-42da-84a6-019d10541197 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:20.859584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:20.863686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:20.863991 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:20.864275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:20.877172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:20.878847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:20.889392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1288/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:21.075822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:21.086610 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60faec-cd9f-44d0-9633-689a21caba69 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:21.090871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:21.091614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:21.092607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:21.092959 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:21.155988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:21.157494 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:21.167105 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1301/2589] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:44:33.135941 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:33.207210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598955-3307-40c3-9344-6b85457a4ef9 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:33.212582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:33.214472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:33.214472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:33.214472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] PATH_INFO: `/v3/users/7e552e09ff564a1ea401c04ab84bf1ae` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:33.216069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e552e09ff564a1ea401c04ab84bf1ae)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:33.218573 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:33.249499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:33.251814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:33.312229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8b757-c1cf-4dac-b32f-edbe662c6809 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:33.316262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:33.316822 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:33.317114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:33.317472 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:33.319855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:33.332316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:33.333759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0158c-7f92-492e-bd81-7815ac2b5a23 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:33.343844 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1302/2590] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:44:33.643802 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e552e09ff564a1ea401c04ab84bf1ae'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:33.657061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e552e09ff564a1ea401c04ab84bf1ae'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:33.657800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e552e09ff564a1ea401c04ab84bf1ae'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:33.664690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e552e09ff564a1ea401c04ab84bf1ae'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:33.744363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e552e09ff564a1ea401c04ab84bf1ae'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:33.752192 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1289/2591] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:33 2022] DELETE /identity/v3/users/7e552e09ff564a1ea401c04ab84bf1ae => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:33.757032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:33.757326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:33.757609 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:33.778593 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:33.780913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:33.845054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1303/2592] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:33.856832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:33.858530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:33.920892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfed5bf-9c43-446b-8d6c-cd0964c3a58c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:33.924911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:33.925556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:33.925836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:33.926153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:33.935541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:33.937908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:33.948357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1290/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:34.483133 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:34.486991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:34.500205 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdb5df-f1b0-4477-9d88-5bdd1b0abb18 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:34.511217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:34.512161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:34.512444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:34.512721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] PATH_INFO: `/v3/projects/c5821d97cc794bd3a7c425e8a1f3d580` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:34.514124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5821d97cc794bd3a7c425e8a1f3d580)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:34.516820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:34.684027 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5821d97cc794bd3a7c425e8a1f3d580', 'request_id': 'req-b8a3eef3-ecee-4df1-97b3-3818460251a7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:34.774141 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5821d97cc794bd3a7c425e8a1f3d580', 'request_id': 'req-b8a3eef3-ecee-4df1-97b3-3818460251a7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:34.781933 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5821d97cc794bd3a7c425e8a1f3d580', 'request_id': 'req-b8a3eef3-ecee-4df1-97b3-3818460251a7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:34.792480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] The token cache is being invalidate because project c5821d97cc794bd3a7c425e8a1f3d580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:34.792779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:34.793450 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:34.795075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1304/2594] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:34 2022] DELETE /identity/v3/projects/c5821d97cc794bd3a7c425e8a1f3d580 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:34.799890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:34.810333 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e315545-8fbe-4f63-bb78-287a6a81cf1b service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:34.867894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:34.868653 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:34.868928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:34.869196 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] PATH_INFO: `/v3/users/4e48fb0dccdf4a06a7a410bb0b98908d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:34.870882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e48fb0dccdf4a06a7a410bb0b98908d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:34.872810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:35.065430 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e48fb0dccdf4a06a7a410bb0b98908d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:35.077866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e48fb0dccdf4a06a7a410bb0b98908d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:35.079358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e48fb0dccdf4a06a7a410bb0b98908d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:35.089403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e48fb0dccdf4a06a7a410bb0b98908d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:35.167574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-187dc9f4-ef4f-4f2e-b3bf-c37d08e1dcd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e48fb0dccdf4a06a7a410bb0b98908d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:35.175400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1291/2595] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:34 2022] DELETE /identity/v3/users/4e48fb0dccdf4a06a7a410bb0b98908d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:35.981226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:35.983923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:36.004650 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3eef3-ecee-4df1-97b3-3818460251a7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:36.111389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:36.112312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.113132 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.113568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] PATH_INFO: `/v3/projects/bc763c6b0d314d2faf881932dc1a43c7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.115269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc763c6b0d314d2faf881932dc1a43c7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:36.118198 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:36.268755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc763c6b0d314d2faf881932dc1a43c7', 'request_id': 'req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:36.338419 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc763c6b0d314d2faf881932dc1a43c7', 'request_id': 'req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:36.350410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc763c6b0d314d2faf881932dc1a43c7', 'request_id': 'req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:36.364056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] The token cache is being invalidate because project bc763c6b0d314d2faf881932dc1a43c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:36.365516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:36.366470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4a0c6353-7c32-4f02-b9a2-3483ce9882f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:36.368490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1305/2596] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:35 2022] DELETE /identity/v3/projects/bc763c6b0d314d2faf881932dc1a43c7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:36.375372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.375901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.376013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.396613 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:36.398121 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:36.462541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1292/2597] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:36.479520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.479813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.480083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.514834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:36.516388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:36.539416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1306/2598] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:36.540105 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:36.555809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9513-3f7c-4005-b150-21d657d6a93c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:36.562170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:36.563667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.565439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.565439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.565903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:44:36.566345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:36.568189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:36.581830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1293/2599] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:44:36.586102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:36.595759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde394-de86-478c-bb06-5e89b2a992ad None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:36.602182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:36.602898 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.603179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.603454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.604183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:36.606120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:36.717036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1307/2600] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:36 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:36.722103 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:36.735090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8f018-fd42-43eb-866a-927bcccc6e4c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:36.830631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:36.831328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.831606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.831882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.832601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:36.834811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:36.931954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1294/2601] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:36 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:36.934260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:36.951078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d871-a423-401b-9ea3-dceca9470ec3 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:36.976481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:36.977192 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:36.977442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:36.977711 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:36.978582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:36.980144 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.012260 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1308/2602] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:44:37.016130 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.028038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7bb3-5005-494c-b8fe-2216f814197e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.035794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baedf6-5ed7-4c94-a149-9f584cbc01bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.036751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baedf6-5ed7-4c94-a149-9f584cbc01bd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.037274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baedf6-5ed7-4c94-a149-9f584cbc01bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.037400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baedf6-5ed7-4c94-a149-9f584cbc01bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.038186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baedf6-5ed7-4c94-a149-9f584cbc01bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:37.039807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baedf6-5ed7-4c94-a149-9f584cbc01bd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.061077 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.072566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ff46e-ed31-4cb4-800f-cdcd684918c0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.073265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1295/2603] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:37.078050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.079227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.079668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.080101 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] PATH_INFO: `/v3/projects/32fe29e33adf4f1f99cfde4d188cfee7/users/26da3e5d8f48410897c61a22b57e880d/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.098600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fe29e33adf4f1f99cfde4d188cfee7, user_id=26da3e5d8f48410897c61a22b57e880d, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:37.101300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.266123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1309/2604] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:37 2022] PUT /identity/v3/projects/32fe29e33adf4f1f99cfde4d188cfee7/users/26da3e5d8f48410897c61a22b57e880d/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:44:37.276911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.277198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.277700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.323214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] MFA Rules not processed for user `26da3e5d8f48410897c61a22b57e880d`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:37.325296 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:37.438104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1296/2605] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:44:37.442910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.564340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9a08c-64e8-40c2-a564-f5a9955c9d67 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.569943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.571289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.571716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.572143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.573012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:37.575664 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.690789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1310/2606] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:37 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:37.695059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.705789 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18fd57-5ff3-48c7-994b-3e3208f5bda9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.763908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.765094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.765446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.765723 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.766468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:37.768439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.814835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.816846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:37.835035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e6c5b-b372-4532-b2f3-e27d5e357ba1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.840289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.841178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.841465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.841739 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] PATH_INFO: `/v3/users/2c652557dbd54165a3498c08b2dd5673` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.843189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c652557dbd54165a3498c08b2dd5673)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:37.845199 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.919956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1297/2607] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:37 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:37.919956 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.929255 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f46f4-b404-432a-ad4d-a32732385ca1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.934402 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.935071 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.935351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.935625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:37.937877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:37.939545 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:37.950100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1298/2608] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:37.954614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:37.965442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805bc7d-bb7a-4bca-b63e-949a2311bc6c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:37.982700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:37.982700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:37.982700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:37.982700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] PATH_INFO: `/v3/projects/ae14f6bb6aee4310a08cddf4d55a1252/users/90d1983156cc47d0b261345785609f9f/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.030446 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae14f6bb6aee4310a08cddf4d55a1252, user_id=90d1983156cc47d0b261345785609f9f, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:38.033811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:38.095376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c652557dbd54165a3498c08b2dd5673'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.105420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c652557dbd54165a3498c08b2dd5673'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.106272 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c652557dbd54165a3498c08b2dd5673'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.107067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c652557dbd54165a3498c08b2dd5673'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.130444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c652557dbd54165a3498c08b2dd5673'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.144146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1299/2609] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:37 2022] PUT /identity/v3/projects/ae14f6bb6aee4310a08cddf4d55a1252/users/90d1983156cc47d0b261345785609f9f/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:38.149977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:38.157746 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:38.220291 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1311/2610] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:37 2022] DELETE /identity/v3/users/2c652557dbd54165a3498c08b2dd5673 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:38.261764 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270db000-86a8-4d8e-ab53-3b63dfd1cca8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:38.328795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1dc47-dc35-4027-a79f-f797503af0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:38.329527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1dc47-dc35-4027-a79f-f797503af0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:38.329813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1dc47-dc35-4027-a79f-f797503af0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:38.330243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1dc47-dc35-4027-a79f-f797503af0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.331325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1dc47-dc35-4027-a79f-f797503af0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:38.332961 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1dc47-dc35-4027-a79f-f797503af0f5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:38.344350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1300/2611] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:38.348411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:38.361855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdfd7c-8451-41db-b129-9498e67e6f67 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:38.369339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:38.370628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:38.371104 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:38.371728 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] PATH_INFO: `/v3/projects/ae14f6bb6aee4310a08cddf4d55a1252/users/90d1983156cc47d0b261345785609f9f/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.374120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae14f6bb6aee4310a08cddf4d55a1252, user_id=90d1983156cc47d0b261345785609f9f, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:38.377134 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:38.403649 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1312/2612] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:38 2022] PUT /identity/v3/projects/ae14f6bb6aee4310a08cddf4d55a1252/users/90d1983156cc47d0b261345785609f9f/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:38.404563 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:38.405530 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:38.405831 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.446452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] MFA Rules not processed for user `90d1983156cc47d0b261345785609f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:38.447691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:38.507783 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:38.510787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:38.560886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1301/2613] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:38.573272 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:38.574855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:38.629550 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bef91-4175-4288-9ca4-35c32d2c7a94 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:38.637388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:38.639028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:38.640014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:38.640449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] PATH_INFO: `/v3/projects/274889e6213c4dfaab0997e2dad420ff` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.642708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274889e6213c4dfaab0997e2dad420ff)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:38.645024 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:38.659674 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b6a7-f06f-4a6b-8a77-a2d90ada0398 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:38.664592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e8948-55b0-4658-bf88-c84ad159ec66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:38.665914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e8948-55b0-4658-bf88-c84ad159ec66 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:38.666197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e8948-55b0-4658-bf88-c84ad159ec66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:38.666623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e8948-55b0-4658-bf88-c84ad159ec66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.678923 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e8948-55b0-4658-bf88-c84ad159ec66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:38.680892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e8948-55b0-4658-bf88-c84ad159ec66 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:38.704325 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1302/2614] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:38.824146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274889e6213c4dfaab0997e2dad420ff', 'request_id': 'req-60099a6e-0960-49ce-a5a7-b50e04524b39'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.902699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274889e6213c4dfaab0997e2dad420ff', 'request_id': 'req-60099a6e-0960-49ce-a5a7-b50e04524b39'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.909577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274889e6213c4dfaab0997e2dad420ff', 'request_id': 'req-60099a6e-0960-49ce-a5a7-b50e04524b39'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.919984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] The token cache is being invalidate because project 274889e6213c4dfaab0997e2dad420ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:38.920203 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.921514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:38.923359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1313/2615] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:38 2022] DELETE /identity/v3/projects/274889e6213c4dfaab0997e2dad420ff => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:44:38.928981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd059-e6fa-46c6-891f-e294283c7b20 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:38.929337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd059-e6fa-46c6-891f-e294283c7b20 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:38.929713 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bd059-e6fa-46c6-891f-e294283c7b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:38.950309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-991bd059-e6fa-46c6-891f-e294283c7b20 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:38.950902 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:38.951596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-991bd059-e6fa-46c6-891f-e294283c7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:38.952885 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:39.016285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60099a6e-0960-49ce-a5a7-b50e04524b39 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.020172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.020831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.021136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.021391 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.023219 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:39.028084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1303/2616] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:39.039497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.039929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.040556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.066262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:39.068257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:39.085749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1304/2617] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:39.091441 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.105035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.164657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e2bf-4270-4826-bd06-6a7456fcb7de None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.167150 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.167329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.167329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.167329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.167329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.167895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:44:39.167895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.167895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.168296 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1314/2618] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:44:39.168443 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1305/2619] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 11:44:39.168606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.177774 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a760e-9e25-45c6-acdd-ebb6456c4fcc service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.183549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.184259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.184505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.184782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.185511 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.187724 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.385093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1315/2620] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:39 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:39.390559 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.403110 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e626-4a3b-49d5-8ac7-b88802af3c40 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.478579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.479300 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.479538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.479825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.480565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.485401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.606862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1306/2621] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:39 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:44:39.614454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.626999 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92403e-37b3-42fc-850b-0841d9e88379 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.633703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.634641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.634880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.635225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.636085 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.637775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.657716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1316/2622] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:39.658996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.668929 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04b82-2f29-47a7-ab0b-3b9016f5fc6f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.673850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.674618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.674825 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.675097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.675837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.677436 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.688392 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1307/2623] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:39.692679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.703281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f43ac4-e2b6-404a-b402-52731a2773d0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.708873 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695b060-23b6-46ed-9d03-084779a1279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.709953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b060-23b6-46ed-9d03-084779a1279e admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.710449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b060-23b6-46ed-9d03-084779a1279e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.715301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695b060-23b6-46ed-9d03-084779a1279e admin admin] PATH_INFO: `/v3/projects/d8e4ac647f0b4403b85acb02762c8132/users/886a7da611874f3d886cdcd87aa9d2b8/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.735797 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695b060-23b6-46ed-9d03-084779a1279e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e4ac647f0b4403b85acb02762c8132, user_id=886a7da611874f3d886cdcd87aa9d2b8, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:39.739851 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695b060-23b6-46ed-9d03-084779a1279e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:39.754979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:39.757204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:39.812010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1317/2624] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:39 2022] PUT /identity/v3/projects/d8e4ac647f0b4403b85acb02762c8132/users/886a7da611874f3d886cdcd87aa9d2b8/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:39.824282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.824282 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.824526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.871298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] MFA Rules not processed for user `886a7da611874f3d886cdcd87aa9d2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:39.872703 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:39.878078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed170f2-baa9-4b48-970c-ce175584456d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:39.970989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:39.971763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:39.972077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:39.972356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:39.974319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:39.981180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1318/2625] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:44:39.998814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:40.000513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:40.058778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:40.058778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:40.064765 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1308/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:40.091162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30150714-6cb8-4760-9be3-e28492a9de53 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:40.101938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:40.103001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:40.103461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:40.103901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:40.113853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:40.115535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:40.125417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1319/2627] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:44.686372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:44.689691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:44.700735 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4d8e-d903-4017-a35c-9da68b9b5a3f service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:44.706094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:44.707015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:44.707372 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:44.707627 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] PATH_INFO: `/v3/users/0d9c367e90704768900cf144a1639c27` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:44.708885 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9c367e90704768900cf144a1639c27)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:44.710868 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:44.924306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9c367e90704768900cf144a1639c27'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:44.937487 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9c367e90704768900cf144a1639c27'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:44.938060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9c367e90704768900cf144a1639c27'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:44.944900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9c367e90704768900cf144a1639c27'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.051405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9c367e90704768900cf144a1639c27'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.058295 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1309/2628] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:44 2022] DELETE /identity/v3/users/0d9c367e90704768900cf144a1639c27 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:45.310422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:45.323005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc2da9-2e32-400e-9030-0a21050583a1 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:45.385737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:45.386527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:45.386806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:45.387078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] PATH_INFO: `/v3/projects/6940c4980bd247c986a305a72a9d1434` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:45.388253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6940c4980bd247c986a305a72a9d1434)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:45.390849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:45.503685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6940c4980bd247c986a305a72a9d1434', 'request_id': 'req-01dff85f-c4c8-4cce-b2a9-8655736f17cb'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.573639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6940c4980bd247c986a305a72a9d1434', 'request_id': 'req-01dff85f-c4c8-4cce-b2a9-8655736f17cb'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.581378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6940c4980bd247c986a305a72a9d1434', 'request_id': 'req-01dff85f-c4c8-4cce-b2a9-8655736f17cb'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.591410 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] The token cache is being invalidate because project 6940c4980bd247c986a305a72a9d1434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:45.594576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.594576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.594576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1320/2629] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:45 2022] DELETE /identity/v3/projects/6940c4980bd247c986a305a72a9d1434 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:44:45.598698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:45.600129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:45.614812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f929a78-1b58-4540-a83b-10fd5210867c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:45.670917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:45.671696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:45.671974 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:45.672250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] PATH_INFO: `/v3/users/fc43a67776d84fc7adbf8c2ad741d577` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:45.673460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc43a67776d84fc7adbf8c2ad741d577)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:45.675411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:45.890345 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc43a67776d84fc7adbf8c2ad741d577'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.902518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc43a67776d84fc7adbf8c2ad741d577'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.903229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc43a67776d84fc7adbf8c2ad741d577'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.910258 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc43a67776d84fc7adbf8c2ad741d577'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.961871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc43a67776d84fc7adbf8c2ad741d577'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:45.969025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1310/2630] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:45 2022] DELETE /identity/v3/users/fc43a67776d84fc7adbf8c2ad741d577 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:46.233625 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:46.235672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:46.249887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff85f-c4c8-4cce-b2a9-8655736f17cb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:46.308814 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:46.309672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:46.309957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:46.310259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] PATH_INFO: `/v3/projects/16d9dd96d339474485d844ea48e08257` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:46.311863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d9dd96d339474485d844ea48e08257)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:46.313507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:46.420418 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d9dd96d339474485d844ea48e08257', 'request_id': 'req-66869c81-9831-4484-9b9f-544332fac77e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:46.493977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d9dd96d339474485d844ea48e08257', 'request_id': 'req-66869c81-9831-4484-9b9f-544332fac77e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:46.501184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d9dd96d339474485d844ea48e08257', 'request_id': 'req-66869c81-9831-4484-9b9f-544332fac77e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:46.512060 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] The token cache is being invalidate because project 16d9dd96d339474485d844ea48e08257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:46.512351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:46.513006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-66869c81-9831-4484-9b9f-544332fac77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:46.514813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1321/2631] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:46 2022] DELETE /identity/v3/projects/16d9dd96d339474485d844ea48e08257 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:50.660200 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:50.661706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:50.674835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa193a5-b3b0-4baf-b66f-39ababc02fa5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:50.730157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:50.731045 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:50.731322 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:50.731596 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] PATH_INFO: `/v3/users/886a7da611874f3d886cdcd87aa9d2b8` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:50.732782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886a7da611874f3d886cdcd87aa9d2b8)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:50.734967 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:50.922584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886a7da611874f3d886cdcd87aa9d2b8'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:50.934817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886a7da611874f3d886cdcd87aa9d2b8'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:50.935523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886a7da611874f3d886cdcd87aa9d2b8'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:50.943994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886a7da611874f3d886cdcd87aa9d2b8'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.019847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886a7da611874f3d886cdcd87aa9d2b8'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.026642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1311/2632] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:50 2022] DELETE /identity/v3/users/886a7da611874f3d886cdcd87aa9d2b8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:51.031615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:51.032126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:51.032256 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:51.049722 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:51.051086 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:51.117669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1322/2633] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:51.128085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:51.129669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:51.191144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf88e17-ef62-4c98-beac-3084bba536a5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:51.194930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00673a0e-2cad-49ca-a480-f1655fb8a0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:51.195575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00673a0e-2cad-49ca-a480-f1655fb8a0bc service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:51.195854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00673a0e-2cad-49ca-a480-f1655fb8a0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:51.196152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00673a0e-2cad-49ca-a480-f1655fb8a0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:51.205689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00673a0e-2cad-49ca-a480-f1655fb8a0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:51.207168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00673a0e-2cad-49ca-a480-f1655fb8a0bc service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:51.220574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1312/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:51.692372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:51.692372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:51.703740 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c9e0-a379-4d47-9416-9914128936ce None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:51.708654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:51.709543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:51.709825 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:51.710156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] PATH_INFO: `/v3/projects/d8e4ac647f0b4403b85acb02762c8132` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:51.711552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e4ac647f0b4403b85acb02762c8132)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:51.713808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:51.854109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e4ac647f0b4403b85acb02762c8132', 'request_id': 'req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.916751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e4ac647f0b4403b85acb02762c8132', 'request_id': 'req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.924401 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e4ac647f0b4403b85acb02762c8132', 'request_id': 'req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.935890 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] The token cache is being invalidate because project d8e4ac647f0b4403b85acb02762c8132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:51.936093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.936848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9dbe5eb5-4596-4282-bce8-6ebe751fdb62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:51.938537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1323/2635] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:51 2022] DELETE /identity/v3/projects/d8e4ac647f0b4403b85acb02762c8132 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:51.944338 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:51.944830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:51.944944 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:51.967005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:51.967005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:52.022794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1313/2636] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:52.032119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.035730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.035730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.050869 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:52.052067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:52.059905 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1324/2637] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:52.064535 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.074274 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c962a-96b4-49c4-a729-491efa5e6861 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.079405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.080048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.080328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.080601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.081332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:44:52.081637 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.083276 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.094985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1314/2638] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:44:52.099295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.108299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29fbe2-0a4a-485c-b186-117deee1f5c9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.113236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.113871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.114146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.114449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.115146 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.117018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.198690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1325/2639] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:52 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:52.203359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.213419 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4fdf-f34d-47e9-860d-dda70d2dd1d0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.270109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.270807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.271087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.271360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.272069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.274023 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.383574 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1315/2640] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:52 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:44:52.387904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.398568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4ca3c-5246-48c3-b947-1b8966d1f57f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.403479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.404238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.404522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.404798 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.405666 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.407288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.418290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1326/2641] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:52.423227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.433782 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f706395-9e5b-4d6a-b84b-5e9c9003c171 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.439619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.440313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.440594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.440865 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.441631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.443271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.456078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1316/2642] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:52.458755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.469088 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fde57-b698-4234-a635-923ede56eef1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.473931 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca6993-5465-4d2e-a692-1cec5fb407bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.474912 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca6993-5465-4d2e-a692-1cec5fb407bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.475264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca6993-5465-4d2e-a692-1cec5fb407bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.475605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca6993-5465-4d2e-a692-1cec5fb407bd admin admin] PATH_INFO: `/v3/projects/199d6b06fd9742b49484ff711e979042/users/257057ea02ef4bf08a01e8a661d3b0dc/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.491850 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca6993-5465-4d2e-a692-1cec5fb407bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=199d6b06fd9742b49484ff711e979042, user_id=257057ea02ef4bf08a01e8a661d3b0dc, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.499376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca6993-5465-4d2e-a692-1cec5fb407bd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.561950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.563659 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:52.576114 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c7b76-6e0e-4afb-88a5-e7dbd95c5ad3 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.581225 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1327/2643] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:52 2022] PUT /identity/v3/projects/199d6b06fd9742b49484ff711e979042/users/257057ea02ef4bf08a01e8a661d3b0dc/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:52.591948 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.592237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.592517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.618031 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] MFA Rules not processed for user `257057ea02ef4bf08a01e8a661d3b0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:52.619264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:52.633464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.634355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.634636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.634904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] PATH_INFO: `/v3/users/26da3e5d8f48410897c61a22b57e880d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.636120 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26da3e5d8f48410897c61a22b57e880d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.638024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.682090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1328/2644] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:44:52.692321 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:52.693701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:52.747686 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ce35-d218-4489-97bd-ebc2196ffe4c None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:52.752050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f7fe6-ac1d-46ea-9fe3-79be3e6f9031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:52.752682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7fe6-ac1d-46ea-9fe3-79be3e6f9031 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.752961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7fe6-ac1d-46ea-9fe3-79be3e6f9031 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.753262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7fe6-ac1d-46ea-9fe3-79be3e6f9031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:52.762204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f7fe6-ac1d-46ea-9fe3-79be3e6f9031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:52.765811 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f7fe6-ac1d-46ea-9fe3-79be3e6f9031 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:52.773163 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1329/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:44:52.862061 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26da3e5d8f48410897c61a22b57e880d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:52.873946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26da3e5d8f48410897c61a22b57e880d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:52.875171 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26da3e5d8f48410897c61a22b57e880d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:52.881766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26da3e5d8f48410897c61a22b57e880d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:52.968356 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26da3e5d8f48410897c61a22b57e880d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:52.974804 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1317/2646] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:52 2022] DELETE /identity/v3/users/26da3e5d8f48410897c61a22b57e880d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:52.979320 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:52.979605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:52.979881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:53.000928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:53.000928 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:53.055300 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1330/2647] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:53.065606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:53.067056 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:53.123725 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bdb12-f986-4230-8973-8d0681dcca5f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:53.127911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:53.128552 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:53.128834 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:53.129111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:53.138068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:53.143582 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:53.149728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1318/2648] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:44:53.625555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:53.631432 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:53.648572 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c932b7-9572-4019-aa55-489270c77d18 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:53.656393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:53.656393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:53.656393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:53.656393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] PATH_INFO: `/v3/projects/32fe29e33adf4f1f99cfde4d188cfee7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:53.657507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fe29e33adf4f1f99cfde4d188cfee7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:53.659464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:53.786136 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fe29e33adf4f1f99cfde4d188cfee7', 'request_id': 'req-bde3f9bf-4c18-4b59-9465-c3a983354f71'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:53.860823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fe29e33adf4f1f99cfde4d188cfee7', 'request_id': 'req-bde3f9bf-4c18-4b59-9465-c3a983354f71'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:53.867971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fe29e33adf4f1f99cfde4d188cfee7', 'request_id': 'req-bde3f9bf-4c18-4b59-9465-c3a983354f71'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:53.879441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] The token cache is being invalidate because project 32fe29e33adf4f1f99cfde4d188cfee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:53.879721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:53.880373 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:53.881949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1331/2649] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:53 2022] DELETE /identity/v3/projects/32fe29e33adf4f1f99cfde4d188cfee7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:53.886508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:53.896651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91214c41-4d6d-4ddb-8907-2d2785cf0648 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:53.950093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:53.950977 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:53.951253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:53.951520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] PATH_INFO: `/v3/users/90d1983156cc47d0b261345785609f9f` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:53.952767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d1983156cc47d0b261345785609f9f)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:53.955226 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:54.176564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d1983156cc47d0b261345785609f9f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:54.188930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d1983156cc47d0b261345785609f9f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:54.189622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d1983156cc47d0b261345785609f9f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:54.196488 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d1983156cc47d0b261345785609f9f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:54.293456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b892b81-1a95-471c-8507-26eb8e8cc8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d1983156cc47d0b261345785609f9f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:54.301205 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1319/2650] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:44:53 2022] DELETE /identity/v3/users/90d1983156cc47d0b261345785609f9f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:44:54.814236 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:54.815778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:54.831280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f9bf-4c18-4b59-9465-c3a983354f71 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:54.888158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:54.889002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:54.889276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:54.889658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] PATH_INFO: `/v3/projects/ae14f6bb6aee4310a08cddf4d55a1252` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:54.891584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae14f6bb6aee4310a08cddf4d55a1252)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:54.893482 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.014110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae14f6bb6aee4310a08cddf4d55a1252', 'request_id': 'req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:55.123028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae14f6bb6aee4310a08cddf4d55a1252', 'request_id': 'req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:55.130554 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae14f6bb6aee4310a08cddf4d55a1252', 'request_id': 'req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:55.140830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] The token cache is being invalidate because project ae14f6bb6aee4310a08cddf4d55a1252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:44:55.141148 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:55.141810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-5a99cce6-7ef8-4aad-8326-aa9b8ff49d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:44:55.143421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1332/2651] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:44:54 2022] DELETE /identity/v3/projects/ae14f6bb6aee4310a08cddf4d55a1252 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:55.151043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.151331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.151609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.169107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:55.170355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:55.229370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1320/2652] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:55.238064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.238561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.238839 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.257261 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:55.258500 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:55.267036 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1333/2653] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:55.271493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:55.285475 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a25cf6-c126-4cfc-b1fb-e13d6e3ab3e1 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:55.291201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:55.291863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.292143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.292413 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.293151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:44:55.293455 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:55.295135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.307813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1321/2654] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:44:55.312910 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:55.322504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4019-91d2-4cc7-9ca5-bd12bf1dbef2 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:55.328285 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:55.328946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.329309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.330577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.331499 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:55.333542 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.449950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1334/2655] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:55 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:55.454918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:55.465739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c859d-a3e5-42aa-8953-cbcf4ae35336 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:55.524852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:55.525518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.525795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.526064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.526809 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:55.531303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.618000 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1322/2656] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:55 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:55.622351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:55.632864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a48a3-322e-40fe-89ff-cff1c12a2631 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:55.637406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:55.638043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.638370 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.638657 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.639386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:55.641923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.652448 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1335/2657] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:44:55.656521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:55.666807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc92b85-ae06-4c0b-9223-52f5d43929a6 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:55.672341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7b15-0883-4e25-b497-ba87ea05f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:55.673006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7b15-0883-4e25-b497-ba87ea05f800 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.673284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7b15-0883-4e25-b497-ba87ea05f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.673576 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7b15-0883-4e25-b497-ba87ea05f800 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.674347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b7b15-0883-4e25-b497-ba87ea05f800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:55.675976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b7b15-0883-4e25-b497-ba87ea05f800 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.685970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1323/2658] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:55.690721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:55.700564 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d661cbb-2522-427d-91d2-1c6c1a512a27 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:55.705177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:55.706067 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.706388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.706660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] PATH_INFO: `/v3/projects/59fdcc1ece6241839adea44e809ad5f5/users/d6288bb9f8bd4c55afa377388e986720/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.720786 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fdcc1ece6241839adea44e809ad5f5, user_id=d6288bb9f8bd4c55afa377388e986720, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:55.723514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:55.820805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1336/2659] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:55 2022] PUT /identity/v3/projects/59fdcc1ece6241839adea44e809ad5f5/users/d6288bb9f8bd4c55afa377388e986720/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:55.839240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:55.839543 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:55.839788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:55.866926 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] MFA Rules not processed for user `d6288bb9f8bd4c55afa377388e986720`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:55.868194 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:55.932260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1324/2660] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:55.937944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.001763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2382fe1-cdc9-4762-a047-8bb6b2a9b699 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.006676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.007428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.007713 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.007988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.008683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.010631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.101836 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1337/2661] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:44:55 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:56.105879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.117494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040a825-685a-4f74-8e96-8a5eccb1c3a6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.173088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.173670 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.173950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.174233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.175006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.176875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.323473 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1325/2662] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:44:56 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:44:56.328062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.338145 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d38e2-ef4f-43b8-9a51-348d29d95d4e admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.343116 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.343882 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.344169 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.344443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.345210 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.346981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.357403 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1338/2663] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:44:56.361845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.371970 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656827-2395-4379-929b-842f82f5d467 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.377609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.378511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.378846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.379128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] PATH_INFO: `/v3/projects/7d31d895c8d745ab8576dd6f5fd4677d/users/398eb6a9f06f4651bdfdf6cd3c155fa0/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.394665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d31d895c8d745ab8576dd6f5fd4677d, user_id=398eb6a9f06f4651bdfdf6cd3c155fa0, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.397321 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.473238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1326/2664] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:56 2022] PUT /identity/v3/projects/7d31d895c8d745ab8576dd6f5fd4677d/users/398eb6a9f06f4651bdfdf6cd3c155fa0/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:44:56.477342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.489111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcfaaa-b4c6-4413-b002-202686163312 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.549121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc0265-492d-45b4-8a3e-bdda3e346754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.549788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0265-492d-45b4-8a3e-bdda3e346754 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.550071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0265-492d-45b4-8a3e-bdda3e346754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.550390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0265-492d-45b4-8a3e-bdda3e346754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.551119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0265-492d-45b4-8a3e-bdda3e346754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.552737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0265-492d-45b4-8a3e-bdda3e346754 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.562512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1339/2665] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:44:56.566751 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.577025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d942-36cd-43d1-a555-05f530515a97 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.582665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.583644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.583988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.584330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] PATH_INFO: `/v3/projects/7d31d895c8d745ab8576dd6f5fd4677d/users/398eb6a9f06f4651bdfdf6cd3c155fa0/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.586594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d31d895c8d745ab8576dd6f5fd4677d, user_id=398eb6a9f06f4651bdfdf6cd3c155fa0, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.589331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.601531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1327/2666] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:44:56 2022] PUT /identity/v3/projects/7d31d895c8d745ab8576dd6f5fd4677d/users/398eb6a9f06f4651bdfdf6cd3c155fa0/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:44:56.611762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.612107 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.615395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.638123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] MFA Rules not processed for user `398eb6a9f06f4651bdfdf6cd3c155fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:44:56.639345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:56.705439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1340/2667] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:44:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:44:56.716055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:44:56.718410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:44:56.779067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9479-4d95-445a-8682-fc15b1d549b5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:44:56.783595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:44:56.784305 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:44:56.784579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:44:56.784855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:44:56.840706 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:44:56.842151 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:44:56.851715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1328/2668] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:44:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:03.226793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:03.236878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f8ccd-aecb-4501-bc4c-a3f6e593a9e1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:03.240961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b97ef-f084-4bfa-bd0e-9a236f402b10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:03.241691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b97ef-f084-4bfa-bd0e-9a236f402b10 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:03.241971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b97ef-f084-4bfa-bd0e-9a236f402b10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:03.242268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b97ef-f084-4bfa-bd0e-9a236f402b10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:03.252785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b97ef-f084-4bfa-bd0e-9a236f402b10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:03.268363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b97ef-f084-4bfa-bd0e-9a236f402b10 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:03.268363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1341/2669] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:03.948682 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:03.950235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:04.013752 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8fc48-9ea8-4558-b3fe-c7531c5b89ad service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:04.019027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:04.019890 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:04.020166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:04.020438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] PATH_INFO: `/v3/users/257057ea02ef4bf08a01e8a661d3b0dc` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:04.021634 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257057ea02ef4bf08a01e8a661d3b0dc)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:04.023588 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:04.242794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257057ea02ef4bf08a01e8a661d3b0dc'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:04.255575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257057ea02ef4bf08a01e8a661d3b0dc'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:04.256280 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257057ea02ef4bf08a01e8a661d3b0dc'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:04.263282 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257057ea02ef4bf08a01e8a661d3b0dc'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:04.344124 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257057ea02ef4bf08a01e8a661d3b0dc'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:04.350526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1329/2670] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:03 2022] DELETE /identity/v3/users/257057ea02ef4bf08a01e8a661d3b0dc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:04.355191 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:04.355662 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:04.355759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:04.380094 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:04.381546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:04.439606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1342/2671] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:04.449400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:04.450826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:04.508985 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fbcc0-f4d5-41dc-b475-03504705c5a8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:04.512747 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a255c-ba7d-47f8-b7a5-fda1f6ca9518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:04.513425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a255c-ba7d-47f8-b7a5-fda1f6ca9518 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:04.513742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a255c-ba7d-47f8-b7a5-fda1f6ca9518 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:04.514010 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a255c-ba7d-47f8-b7a5-fda1f6ca9518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:04.523445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a255c-ba7d-47f8-b7a5-fda1f6ca9518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:04.524871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a255c-ba7d-47f8-b7a5-fda1f6ca9518 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:04.535629 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1330/2672] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:04.935859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:04.938521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:04.950283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e756d-4397-4d27-97bb-ad1818a8b71b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:04.955382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:04.956248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:04.956528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:04.956806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] PATH_INFO: `/v3/projects/199d6b06fd9742b49484ff711e979042` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:04.958016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=199d6b06fd9742b49484ff711e979042)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:04.960005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.118383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199d6b06fd9742b49484ff711e979042', 'request_id': 'req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:05.177644 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199d6b06fd9742b49484ff711e979042', 'request_id': 'req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:05.184018 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199d6b06fd9742b49484ff711e979042', 'request_id': 'req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:05.194269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] The token cache is being invalidate because project 199d6b06fd9742b49484ff711e979042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:05.194583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:05.195210 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-35934aa7-d58f-4e0f-91fc-4812a36bfa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:05.196735 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1343/2673] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:04 2022] DELETE /identity/v3/projects/199d6b06fd9742b49484ff711e979042 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:05.202425 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.203015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.203015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.220739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:05.221930 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:05.279812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1331/2674] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:05.289506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.289796 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.290076 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.308808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:05.309998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:05.317859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1344/2675] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:05.322052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.331790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b255c3-ab0f-461b-83a5-b5281ff336db None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.336365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.337004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.337281 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.337553 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.338313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:45:05.338614 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.340206 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.352181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1332/2676] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:45:05.356754 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.366803 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf228cd-b9ff-4d87-a32f-8759c1ff6749 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.372030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.372616 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.372893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.373193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.373893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.376160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.454375 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1345/2677] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:05 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:05.458595 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.469140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dfd3e-203e-4d92-bc81-53713853a1b1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.524685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.525328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.525605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.525873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.526599 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.528511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.612415 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1333/2678] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:05 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:05.616661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.627640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0cc2-c52e-480a-b7f5-4667cbd3b0f4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.632168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.632816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.637158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.637158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.637158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.637158 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.647186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1346/2679] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:05.651248 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.661786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98221c4-f731-415d-b7c6-33ea961716d5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.666360 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad267a1-a3bf-43a5-b7cd-4d7a416720c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.667009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad267a1-a3bf-43a5-b7cd-4d7a416720c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.667284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad267a1-a3bf-43a5-b7cd-4d7a416720c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.667555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad267a1-a3bf-43a5-b7cd-4d7a416720c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.668279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad267a1-a3bf-43a5-b7cd-4d7a416720c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.669861 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad267a1-a3bf-43a5-b7cd-4d7a416720c7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.679500 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1334/2680] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:05.683640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.693481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406655af-475d-4da5-93ea-a1f0739a478c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.698068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.698957 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.699237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.699512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] PATH_INFO: `/v3/projects/da822c18020e4584a406c5f6d97722e1/users/115a9cd6e6af483880f75fe6568248c8/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.713877 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da822c18020e4584a406c5f6d97722e1, user_id=115a9cd6e6af483880f75fe6568248c8, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.716549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:05.792072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1347/2681] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:05 2022] PUT /identity/v3/projects/da822c18020e4584a406c5f6d97722e1/users/115a9cd6e6af483880f75fe6568248c8/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:05.802499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.802790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.803068 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.830420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] MFA Rules not processed for user `115a9cd6e6af483880f75fe6568248c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:05.831620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:05.892906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1335/2682] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:05.897347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:05.966837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53567d-7061-4154-9aaf-4fdbe6195559 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:05.971507 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:05.972152 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:05.972428 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:05.972698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:05.973426 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:05.975417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.060078 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1348/2683] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:05 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:06.061483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:06.073242 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dcf7c-56c1-4ddf-9446-d5ac069456be None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:06.138801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:06.139472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.139755 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.141188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.141911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:06.143933 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.235807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1336/2684] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:06 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:06.239721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:06.250447 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7391-c451-4e6d-acc6-55b963d1dcc7 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:06.255421 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:06.256110 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.262055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.262055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.262055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:06.262055 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.270708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1349/2685] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:06.274949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:06.286126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204bfff-841b-4583-8e0b-a66d9fffcbe7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:06.290743 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:06.291619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.291895 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.292166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] PATH_INFO: `/v3/projects/706d1e7a326847b283ecf35fa2df51ee/users/0f8091e682af4e7fadfb83ec7f042ea2/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.306855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706d1e7a326847b283ecf35fa2df51ee, user_id=0f8091e682af4e7fadfb83ec7f042ea2, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:06.309491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.407457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1337/2686] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:06 2022] PUT /identity/v3/projects/706d1e7a326847b283ecf35fa2df51ee/users/0f8091e682af4e7fadfb83ec7f042ea2/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:06.411364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:06.421818 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6eb4-3b3e-4ef9-b2a4-1f6802767f08 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:06.476070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2ed6-2e7c-4725-97b4-3207c15c08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:06.476908 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2ed6-2e7c-4725-97b4-3207c15c08a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.477051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2ed6-2e7c-4725-97b4-3207c15c08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.477287 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2ed6-2e7c-4725-97b4-3207c15c08a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.478008 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2ed6-2e7c-4725-97b4-3207c15c08a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:06.479640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2ed6-2e7c-4725-97b4-3207c15c08a4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.490009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1350/2687] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:06.494491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:06.505878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb3c44-19a5-4c80-a043-e73e8697dd05 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:06.510951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:06.511914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.512293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.512680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] PATH_INFO: `/v3/projects/706d1e7a326847b283ecf35fa2df51ee/users/0f8091e682af4e7fadfb83ec7f042ea2/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.514762 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706d1e7a326847b283ecf35fa2df51ee, user_id=0f8091e682af4e7fadfb83ec7f042ea2, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:06.517406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.527602 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1338/2688] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:06 2022] PUT /identity/v3/projects/706d1e7a326847b283ecf35fa2df51ee/users/0f8091e682af4e7fadfb83ec7f042ea2/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:06.538379 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.538672 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.538950 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.565714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] MFA Rules not processed for user `0f8091e682af4e7fadfb83ec7f042ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:06.566954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:06.631446 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1351/2689] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:06.640935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:06.642696 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:06.697398 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a799f-5bdf-4c39-bba8-872b8534b4f1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:06.700989 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b06b33-ce9a-4491-9197-01ef2c773326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:06.701620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06b33-ce9a-4491-9197-01ef2c773326 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:06.701896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06b33-ce9a-4491-9197-01ef2c773326 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:06.702169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b06b33-ce9a-4491-9197-01ef2c773326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:06.711097 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b06b33-ce9a-4491-9197-01ef2c773326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:06.712531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b06b33-ce9a-4491-9197-01ef2c773326 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:06.723012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1339/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:09.723628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:09.787092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8c00c-8762-4028-9d46-c3bb4d2918f0 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:09.791566 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:09.797147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:09.797147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:09.797147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] PATH_INFO: `/v3/users/115a9cd6e6af483880f75fe6568248c8` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:09.797147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] RBAC: Authorizing `identity:delete_user(user_id=115a9cd6e6af483880f75fe6568248c8)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:09.797147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:09.954483 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115a9cd6e6af483880f75fe6568248c8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:09.961358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115a9cd6e6af483880f75fe6568248c8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:09.962063 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115a9cd6e6af483880f75fe6568248c8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:09.962699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115a9cd6e6af483880f75fe6568248c8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:09.975103 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115a9cd6e6af483880f75fe6568248c8'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:10.058789 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1352/2691] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:09 2022] DELETE /identity/v3/users/115a9cd6e6af483880f75fe6568248c8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:10.063015 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:10.063960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:10.063960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:10.089988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:10.089988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:10.156733 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1340/2692] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:10.166710 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:10.168118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:10.224763 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13943ab7-51b4-4a0b-8549-1aadd85819da admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:10.228351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:10.228981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:10.229259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:10.229533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:10.239091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:10.240520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:10.251607 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1353/2693] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:10.696461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:10.704089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:10.710575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d585600-372c-42a4-9d48-fb5f97d3cce3 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:10.715214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:10.716064 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:10.716397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:10.716675 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] PATH_INFO: `/v3/projects/da822c18020e4584a406c5f6d97722e1` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:10.720318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da822c18020e4584a406c5f6d97722e1)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:10.722294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:10.858516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da822c18020e4584a406c5f6d97722e1', 'request_id': 'req-4a8112bf-20b4-42a7-a1bd-1b7986beae66'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:10.932531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da822c18020e4584a406c5f6d97722e1', 'request_id': 'req-4a8112bf-20b4-42a7-a1bd-1b7986beae66'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:10.938237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da822c18020e4584a406c5f6d97722e1', 'request_id': 'req-4a8112bf-20b4-42a7-a1bd-1b7986beae66'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:10.950410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] The token cache is being invalidate because project da822c18020e4584a406c5f6d97722e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:10.950410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:10.950908 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:10.952969 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1341/2694] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:10 2022] DELETE /identity/v3/projects/da822c18020e4584a406c5f6d97722e1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:10.957342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:10.967235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec607-90a3-4834-9304-859cacb906aa service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:11.022881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:11.023746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:11.024037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:11.024315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] PATH_INFO: `/v3/users/0f8091e682af4e7fadfb83ec7f042ea2` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:11.025514 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8091e682af4e7fadfb83ec7f042ea2)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:11.027471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:11.257290 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8091e682af4e7fadfb83ec7f042ea2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:11.264052 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8091e682af4e7fadfb83ec7f042ea2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:11.264716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8091e682af4e7fadfb83ec7f042ea2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:11.265881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8091e682af4e7fadfb83ec7f042ea2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:11.277118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e22893e-8f75-42db-90c4-4e4aa05beebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8091e682af4e7fadfb83ec7f042ea2'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:11.410232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1354/2695] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:10 2022] DELETE /identity/v3/users/0f8091e682af4e7fadfb83ec7f042ea2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:11.831932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:11.833493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:11.846711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8112bf-20b4-42a7-a1bd-1b7986beae66 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:11.903878 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:11.904732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:11.905014 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:11.905287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] PATH_INFO: `/v3/projects/706d1e7a326847b283ecf35fa2df51ee` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:11.907111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] RBAC: Authorizing `identity:delete_project(project_id=706d1e7a326847b283ecf35fa2df51ee)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:11.909019 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.041170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706d1e7a326847b283ecf35fa2df51ee', 'request_id': 'req-7b56a8a9-df55-4eda-b872-4c826368943c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:12.126939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706d1e7a326847b283ecf35fa2df51ee', 'request_id': 'req-7b56a8a9-df55-4eda-b872-4c826368943c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:12.132594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706d1e7a326847b283ecf35fa2df51ee', 'request_id': 'req-7b56a8a9-df55-4eda-b872-4c826368943c'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:12.144492 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] The token cache is being invalidate because project 706d1e7a326847b283ecf35fa2df51ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:12.149907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:12.149907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7b56a8a9-df55-4eda-b872-4c826368943c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:12.149907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1342/2696] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:11 2022] DELETE /identity/v3/projects/706d1e7a326847b283ecf35fa2df51ee => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:12.152689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.153156 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.153259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.170985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:12.172683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:12.228187 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1355/2697] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:12.237346 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.237626 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.237896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.256635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:12.258721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:12.265856 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1343/2698] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:12.270062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:12.279467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0adc90-88b5-4ac2-b19a-3eca05a2739b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:12.284121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:12.284758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.285038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.285309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.286034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:45:12.286367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:12.287975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.299932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1356/2699] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:45:12.304315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:12.314358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84790c9-92cd-427a-ae15-eb64be5c65d9 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:12.319016 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:12.319652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.319928 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.320202 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.320903 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:12.322841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.423498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1344/2700] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:12 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:12.427733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:12.438279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c84ed8-3691-4b81-86ce-6ded9dd187cd admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:12.492517 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:12.493184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.493461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.493736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.494468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:12.496385 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.615188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1357/2701] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:12 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:12.619316 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:12.630135 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6827192-d0f6-4844-8db8-18aeedd083b8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:12.634673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:12.635318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.635591 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.635858 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.636580 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:12.638170 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.649330 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1345/2702] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:12.653520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:12.663576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46dac3-72e2-4b67-abb2-8c535cc58a93 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:12.668245 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4728e90-0b84-43ca-b99d-68bbe9e3987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:12.668892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4728e90-0b84-43ca-b99d-68bbe9e3987e admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.669174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4728e90-0b84-43ca-b99d-68bbe9e3987e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.669457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4728e90-0b84-43ca-b99d-68bbe9e3987e admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.670186 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4728e90-0b84-43ca-b99d-68bbe9e3987e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:12.671833 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4728e90-0b84-43ca-b99d-68bbe9e3987e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.681504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1358/2703] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:12.685493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:12.695795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71a535-5539-47e3-b370-c189a05be212 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:12.700309 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:12.701191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.701467 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.701750 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] PATH_INFO: `/v3/projects/41005a43296e4ca1a2f473015a96108c/users/c4ff4785d8634045b4325e9f39fc7354/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.716623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41005a43296e4ca1a2f473015a96108c, user_id=c4ff4785d8634045b4325e9f39fc7354, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:12.719348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:12.847012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1346/2704] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:12 2022] PUT /identity/v3/projects/41005a43296e4ca1a2f473015a96108c/users/c4ff4785d8634045b4325e9f39fc7354/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:12.857767 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:12.858050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:12.858363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:12.885229 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] MFA Rules not processed for user `c4ff4785d8634045b4325e9f39fc7354`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:12.886465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:12.951642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1359/2705] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:12.956780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.026324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0a11b-ecdb-401a-9178-7e35077babb8 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.032405 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.033084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.033370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.033644 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.034383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.036306 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.136648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1347/2706] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:12 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:13.141193 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.152473 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903ffa3-fd18-4860-a01b-8ad710d16b6b None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.208177 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.208824 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.209053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.209311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.210013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.211979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.324474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1360/2707] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:13 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:13.329182 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.339605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96809b2-d427-457e-b41a-6cc9e4cf2b7d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.344474 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.345128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.345410 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.345685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.346447 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.348058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.359479 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1348/2708] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:13.363766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.374030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8443-62e6-482e-9dbd-8d3a8d2d3bfb admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.379314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.383915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.383915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.383915 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] PATH_INFO: `/v3/projects/05963ee6e53d4d16a3c44e6b9e8fdba5/users/e92adf4fda784459a81934f58c70df69/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.396583 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05963ee6e53d4d16a3c44e6b9e8fdba5, user_id=e92adf4fda784459a81934f58c70df69, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.399323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.470051 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1361/2709] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:13 2022] PUT /identity/v3/projects/05963ee6e53d4d16a3c44e6b9e8fdba5/users/e92adf4fda784459a81934f58c70df69/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:13.473910 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.484102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca65753-0bbd-4436-af2e-df5aa39c6ad2 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.540315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1dce-ec2b-4ba4-9ecf-dafbcaf213ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.540951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1dce-ec2b-4ba4-9ecf-dafbcaf213ae admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.541229 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1dce-ec2b-4ba4-9ecf-dafbcaf213ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.541501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1dce-ec2b-4ba4-9ecf-dafbcaf213ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.542238 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d1dce-ec2b-4ba4-9ecf-dafbcaf213ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.543847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d1dce-ec2b-4ba4-9ecf-dafbcaf213ae admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.553583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1349/2710] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:13.558689 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.569350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba7cb0-a4f2-41ce-b14b-5b63d8863ea2 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.573953 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.574849 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.575135 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.575411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] PATH_INFO: `/v3/projects/05963ee6e53d4d16a3c44e6b9e8fdba5/users/e92adf4fda784459a81934f58c70df69/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.577380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=05963ee6e53d4d16a3c44e6b9e8fdba5, user_id=e92adf4fda784459a81934f58c70df69, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.580624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.590581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1362/2711] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:13 2022] PUT /identity/v3/projects/05963ee6e53d4d16a3c44e6b9e8fdba5/users/e92adf4fda784459a81934f58c70df69/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:13.601810 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.602087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.602388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.629491 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] MFA Rules not processed for user `e92adf4fda784459a81934f58c70df69`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:13.630775 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:13.696369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1350/2712] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:13.705946 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.707611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:13.765124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2a5e7-8e88-4110-849e-0273fe5d78bf admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.768988 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.769621 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.769901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.770172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.779636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.781071 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.790316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1363/2713] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:13.890680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:13.900168 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139493c3-f444-4a5b-993f-cf76ed19fc33 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:13.903698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016f620-b4b2-4f35-81cd-3628a8c5f3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:13.904329 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f620-b4b2-4f35-81cd-3628a8c5f3dd service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:13.904605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f620-b4b2-4f35-81cd-3628a8c5f3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:13.904879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016f620-b4b2-4f35-81cd-3628a8c5f3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:13.959128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016f620-b4b2-4f35-81cd-3628a8c5f3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:13.960570 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016f620-b4b2-4f35-81cd-3628a8c5f3dd service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:13.969376 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1351/2714] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:20.240847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:20.303469 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a0797-f824-4c76-be8c-38689f916db7 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:20.308183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:20.309044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:20.309322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:20.309596 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] PATH_INFO: `/v3/users/c4ff4785d8634045b4325e9f39fc7354` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:20.310927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ff4785d8634045b4325e9f39fc7354)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:20.316881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:20.670853 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ff4785d8634045b4325e9f39fc7354'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:20.678438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ff4785d8634045b4325e9f39fc7354'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:20.679068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ff4785d8634045b4325e9f39fc7354'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:20.679747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ff4785d8634045b4325e9f39fc7354'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:20.691751 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ff4785d8634045b4325e9f39fc7354'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:20.796834 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1364/2715] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:20 2022] DELETE /identity/v3/users/c4ff4785d8634045b4325e9f39fc7354 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:20.801610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:20.802125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:20.802125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:20.819527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:20.820714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:20.877702 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1352/2716] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:20.887731 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:20.889154 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:20.948546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20958e-4481-49bb-aebe-0e3b07f932e6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:20.952322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:20.954357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:20.954357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:20.954582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:20.969557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:20.971097 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:20.981160 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1365/2717] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:21.391625 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:21.393083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:21.408855 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e59e-1f8b-4083-be67-4579cfd335b6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:21.414005 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:21.416955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:21.416955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:21.416955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] PATH_INFO: `/v3/projects/41005a43296e4ca1a2f473015a96108c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:21.416955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41005a43296e4ca1a2f473015a96108c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:21.419128 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:21.576347 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41005a43296e4ca1a2f473015a96108c', 'request_id': 'req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:21.705506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41005a43296e4ca1a2f473015a96108c', 'request_id': 'req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:21.712123 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41005a43296e4ca1a2f473015a96108c', 'request_id': 'req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:21.723456 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] The token cache is being invalidate because project 41005a43296e4ca1a2f473015a96108c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:21.723732 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:21.724378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:21.726043 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1353/2718] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:21 2022] DELETE /identity/v3/projects/41005a43296e4ca1a2f473015a96108c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:21.730125 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:21.739924 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1651d46-64fe-4909-af19-68b771b69b64 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:21.801289 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:21.802409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:21.802690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:21.802963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] PATH_INFO: `/v3/users/e92adf4fda784459a81934f58c70df69` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:21.804317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92adf4fda784459a81934f58c70df69)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:21.806254 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:22.040984 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92adf4fda784459a81934f58c70df69'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.048380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92adf4fda784459a81934f58c70df69'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.049044 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92adf4fda784459a81934f58c70df69'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.050007 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92adf4fda784459a81934f58c70df69'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.061955 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ec001783-ab06-4b6c-a3ce-b763399a6d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92adf4fda784459a81934f58c70df69'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.164011 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1366/2719] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:21 2022] DELETE /identity/v3/users/e92adf4fda784459a81934f58c70df69 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:22.593739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:22.595268 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:22.607932 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6d9b-b9a4-466c-ab54-936cbdee943b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:22.664102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:22.664955 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:22.665227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:22.665498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] PATH_INFO: `/v3/projects/05963ee6e53d4d16a3c44e6b9e8fdba5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:22.666705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05963ee6e53d4d16a3c44e6b9e8fdba5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:22.668594 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:22.787550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05963ee6e53d4d16a3c44e6b9e8fdba5', 'request_id': 'req-a38cdc86-0138-4122-b0de-f4a315f3b180'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.884050 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05963ee6e53d4d16a3c44e6b9e8fdba5', 'request_id': 'req-a38cdc86-0138-4122-b0de-f4a315f3b180'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.889883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05963ee6e53d4d16a3c44e6b9e8fdba5', 'request_id': 'req-a38cdc86-0138-4122-b0de-f4a315f3b180'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.901284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] The token cache is being invalidate because project 05963ee6e53d4d16a3c44e6b9e8fdba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:22.901571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.903457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-a38cdc86-0138-4122-b0de-f4a315f3b180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:22.904029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1354/2720] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:22 2022] DELETE /identity/v3/projects/05963ee6e53d4d16a3c44e6b9e8fdba5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:22.910050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:22.910565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:22.910734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:22.933699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:22.934967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:22.997544 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1367/2721] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:23.005671 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.005979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.006237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.024695 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:23.025918 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:23.034892 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1355/2722] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:23.039288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.049580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278b75-b0c5-4084-95e6-484bb793cc63 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.054334 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.054994 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.055273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.055546 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.056278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:45:23.056582 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.058190 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.070581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1368/2723] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:45:23.075008 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.084779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f31a0e-5b76-42de-89ca-a73dc969119d None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.089353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.089988 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.090324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.090600 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.091298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.093177 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.214040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1356/2724] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:23 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:23.218588 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.228520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9317db-f127-4a7b-b738-45cb9ee07b91 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.281729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.282485 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.282775 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.283050 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] PATH_INFO: `/v3/users` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.283744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.285674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.376153 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1369/2725] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:23 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:23.380287 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.391901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4217e-8496-40b0-9d6e-0d58dca0eb83 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.396583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.397260 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.397541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.397813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.398618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.400210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.411009 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1357/2726] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:23.414968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.428194 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e54b7-5542-4b84-a08f-4ce39bf56a27 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.432820 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ec7e9-6c79-4284-bf50-136396ebec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.433465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ec7e9-6c79-4284-bf50-136396ebec52 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.433747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ec7e9-6c79-4284-bf50-136396ebec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.434023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ec7e9-6c79-4284-bf50-136396ebec52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.434793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ec7e9-6c79-4284-bf50-136396ebec52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.436411 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ec7e9-6c79-4284-bf50-136396ebec52 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.446913 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1370/2727] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:23.451111 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.461442 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c4dc-e50f-4690-a036-fa2d65fd5912 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.466046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.466948 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.467231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.467504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] PATH_INFO: `/v3/projects/6c6f9e8ac2d64eccb59ca3a425925216/users/b4a7807d1296434fbaac9b1f2dc9ba0f/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.481963 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6f9e8ac2d64eccb59ca3a425925216, user_id=b4a7807d1296434fbaac9b1f2dc9ba0f, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.485719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.581283 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1358/2728] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:23 2022] PUT /identity/v3/projects/6c6f9e8ac2d64eccb59ca3a425925216/users/b4a7807d1296434fbaac9b1f2dc9ba0f/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:23.591347 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dae52-3804-4523-8b36-ec861331d6d0 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.591639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dae52-3804-4523-8b36-ec861331d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.591916 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dae52-3804-4523-8b36-ec861331d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.619053 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-d61dae52-3804-4523-8b36-ec861331d6d0 None None] MFA Rules not processed for user `b4a7807d1296434fbaac9b1f2dc9ba0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:23.620233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d61dae52-3804-4523-8b36-ec861331d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:23.682680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1371/2729] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:23.693159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:23.694917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:23.750946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4a73b-4dac-486f-a9ab-fc5ddfad0ee1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:23.754650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:23.755288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:23.755565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:23.755832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:23.764051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:23.765513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:23.774337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1359/2730] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:29.906505 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:29.907012 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:29.907166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:29.924757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] MFA Rules not processed for user `b4b5d6a7bf664a98bb17f6fcbbca69bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:29.925962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:29.980794 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1372/2731] 10.222.0.20 () {58 vars in 967 bytes} [Mon Jan 10 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:30.143314 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:30.146357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:30.225651 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51699781-7846-4a1e-87ff-227522c10953 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:30.230630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bccfc902f07f4298afeba04f08176891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:30.231269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:30.231550 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:30.231823 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:30.240678 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:30.242370 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:30.253876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1360/2732] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Jan 10 11:45:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 11:45:35.868468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:35.870057 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:35.945835 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1959-6a48-4726-b341-17fc78e76365 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:35.954171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:35.954871 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:35.955149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:35.955424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:35.957412 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:35.964946 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:35.967533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:35.975723 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:35.977399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe9530-5aff-4452-abe4-6a20ba485fd4 service placement] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:35.998464 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1373/2733] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:36.061389 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00f10e-3ad8-410b-bcff-5acbaffa2daf service swift] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:36.067622 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:36.068509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:36.068788 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:36.069271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] PATH_INFO: `/v3/users/d6288bb9f8bd4c55afa377388e986720` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:36.070561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6288bb9f8bd4c55afa377388e986720)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:36.072501 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:36.309266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6288bb9f8bd4c55afa377388e986720'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:36.321427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6288bb9f8bd4c55afa377388e986720'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:36.322145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6288bb9f8bd4c55afa377388e986720'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:36.331029 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6288bb9f8bd4c55afa377388e986720'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:36.442351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6288bb9f8bd4c55afa377388e986720'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:36.448817 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1361/2734] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:35 2022] DELETE /identity/v3/users/d6288bb9f8bd4c55afa377388e986720 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:36.454770 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:36.455080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:36.455327 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:36.475468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:36.476674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:36.555298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1374/2735] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:36.565319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:36.566807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:36.629423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861161e0-6b07-4536-8d76-913d731b71b1 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:36.633243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:36.633949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:36.634269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:36.634548 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:36.644598 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:36.646093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:36.656133 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1362/2736] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:37.342029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:37.343246 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:37.361807 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93372913-4e3a-49ed-9652-a51ad743b023 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:37.379350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:37.380683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:37.382400 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:37.382900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] PATH_INFO: `/v3/projects/59fdcc1ece6241839adea44e809ad5f5` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:37.396674 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fdcc1ece6241839adea44e809ad5f5)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:37.399029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:37.536332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fdcc1ece6241839adea44e809ad5f5', 'request_id': 'req-703428f7-f6cc-4e0b-a979-ed936ec76281'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.604903 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fdcc1ece6241839adea44e809ad5f5', 'request_id': 'req-703428f7-f6cc-4e0b-a979-ed936ec76281'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.612457 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fdcc1ece6241839adea44e809ad5f5', 'request_id': 'req-703428f7-f6cc-4e0b-a979-ed936ec76281'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.625859 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] The token cache is being invalidate because project 59fdcc1ece6241839adea44e809ad5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:37.626683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.627106 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.629520 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1375/2737] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:37 2022] DELETE /identity/v3/projects/59fdcc1ece6241839adea44e809ad5f5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:37.633572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:37.645648 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195cd7f-375a-4908-9fdd-569adb9670f5 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:37.706504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:37.707712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:37.708223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:37.708650 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] PATH_INFO: `/v3/users/398eb6a9f06f4651bdfdf6cd3c155fa0` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:37.710102 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] RBAC: Authorizing `identity:delete_user(user_id=398eb6a9f06f4651bdfdf6cd3c155fa0)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:37.712426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:37.953741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398eb6a9f06f4651bdfdf6cd3c155fa0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.974257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398eb6a9f06f4651bdfdf6cd3c155fa0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.974257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398eb6a9f06f4651bdfdf6cd3c155fa0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:37.976673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398eb6a9f06f4651bdfdf6cd3c155fa0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:38.068052 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7a4e205d-8ced-418f-b5f9-44101d1bb14e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398eb6a9f06f4651bdfdf6cd3c155fa0'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:38.078417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1363/2738] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:37 2022] DELETE /identity/v3/users/398eb6a9f06f4651bdfdf6cd3c155fa0 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:38.721183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:38.722640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:38.745755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703428f7-f6cc-4e0b-a979-ed936ec76281 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:38.809690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:38.809690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:38.809690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:38.809690 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] PATH_INFO: `/v3/projects/7d31d895c8d745ab8576dd6f5fd4677d` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:38.810510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d31d895c8d745ab8576dd6f5fd4677d)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:38.811130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.042705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d31d895c8d745ab8576dd6f5fd4677d', 'request_id': 'req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:39.159113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d31d895c8d745ab8576dd6f5fd4677d', 'request_id': 'req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:39.166949 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d31d895c8d745ab8576dd6f5fd4677d', 'request_id': 'req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:39.180126 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] The token cache is being invalidate because project 7d31d895c8d745ab8576dd6f5fd4677d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:39.180416 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:39.181113 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-570dc77f-6d73-4dd0-a617-75c38f3ee3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:39.182698 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1376/2739] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:38 2022] DELETE /identity/v3/projects/7d31d895c8d745ab8576dd6f5fd4677d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:39.189047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.190164 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.190541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.212575 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:39.213836 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:39.296714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1364/2740] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:39.302068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.302381 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.302664 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.321714 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:39.323440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:39.346605 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1377/2741] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:45:39.349078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.359036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa315a-0ce9-44a4-af1e-4c412d3f97dc None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.364249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.364824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.365099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.365560 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.366497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:45:39.366984 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.368811 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.385852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1365/2742] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:45:39.387178 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.398577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7280ce-d7bb-4e65-85f0-d5be3c8cb41d None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.405568 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.407777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.408326 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.409032 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.409881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.411920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.639573 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1378/2743] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:39 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:39.645160 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.655889 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bfa6c-7e18-47bb-baf9-5c39a2154aa0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.721303 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.721966 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.722273 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.722547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.723245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.725264 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.820824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1366/2744] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:39 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:39.824968 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.836954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb0681-0b42-4c8f-90d9-e212d3f27520 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.844137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.845159 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.845678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.846168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.847119 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.848700 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.860947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1379/2745] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:39.864998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.876694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28efc7-c15d-4a57-8207-d7d1ef36f11e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.881371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.882025 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.882340 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.882619 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.883378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.885184 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.898681 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1367/2746] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:39.906004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.917247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d9531-da9d-4030-9fdc-cb65964a94ff admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.923659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb10082-4576-47b2-83b0-674fb9c8cf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.927013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb10082-4576-47b2-83b0-674fb9c8cf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.927301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb10082-4576-47b2-83b0-674fb9c8cf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.927578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb10082-4576-47b2-83b0-674fb9c8cf43 admin admin] PATH_INFO: `/v3/projects/0fc93cc5053a480da6a9bad48173010c/users/ced6ad5fcaf24446a1996f4cf34b6ef0/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.939585 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:39.942412 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:39.957420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb10082-4576-47b2-83b0-674fb9c8cf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc93cc5053a480da6a9bad48173010c, user_id=ced6ad5fcaf24446a1996f4cf34b6ef0, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.960112 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb10082-4576-47b2-83b0-674fb9c8cf43 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:39.960767 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90822216-06d9-46bc-963f-58dc5a0b61f9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:39.966004 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:39.971714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:39.971714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:39.971714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] PATH_INFO: `/v3/users/54f31a023173496e977e99bbc0eb6b8b` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:39.971714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f31a023173496e977e99bbc0eb6b8b)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:39.971714 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:40.160295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1380/2747] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:39 2022] PUT /identity/v3/projects/0fc93cc5053a480da6a9bad48173010c/users/ced6ad5fcaf24446a1996f4cf34b6ef0/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:40.171223 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.171515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.171788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.212779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] MFA Rules not processed for user `ced6ad5fcaf24446a1996f4cf34b6ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:40.214013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:40.289028 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1381/2748] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:45:40.293777 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:40.337616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f31a023173496e977e99bbc0eb6b8b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:40.362198 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f31a023173496e977e99bbc0eb6b8b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:40.363063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f31a023173496e977e99bbc0eb6b8b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:40.368535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb1cd-1c76-49a4-8104-1ee130431c49 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:40.372866 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f31a023173496e977e99bbc0eb6b8b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:40.376660 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:40.377854 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.378702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.378702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.379923 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:40.382409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:40.467902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f31a023173496e977e99bbc0eb6b8b'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:40.475860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1368/2749] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:39 2022] DELETE /identity/v3/users/54f31a023173496e977e99bbc0eb6b8b => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:40.522524 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1382/2750] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:40 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:40.526917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:40.528383 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:40.601132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd60ad-0827-4dc9-bf2c-f44f3524aec0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:40.661658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:40.662366 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.662646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.662916 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.663641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:40.665679 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:40.740575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:40.740920 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:40.754010 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd532-0f0a-443d-9a31-421ac68b65b5 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:40.758892 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:40.759760 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.760037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.760311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] PATH_INFO: `/v3/projects/e45c180d632e41cdb97880086d7705c2` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.761561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45c180d632e41cdb97880086d7705c2)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:40.763486 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:40.833150 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1369/2751] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:40 2022] POST /identity/v3/users => generated 294 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:40.851884 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:40.862331 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eda71e-ce85-4eb8-a85e-b89360a436a5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:40.867136 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:40.867759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.868039 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.868313 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.869044 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:40.870680 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:40.881096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1370/2752] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:40.885084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:40.895863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfcb80-b4bc-4deb-8a8d-8b253ad67664 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:40.900529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:40.901162 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.901444 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.901718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.902471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:40.904047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:40.914537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1371/2753] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:40.920700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:40.930088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc94d31-8545-49ed-8173-a0cde1139fad admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:40.935106 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0f0c-3b4e-40be-8f66-ba5dbf04e785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:40.935960 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0f0c-3b4e-40be-8f66-ba5dbf04e785 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:40.936233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0f0c-3b4e-40be-8f66-ba5dbf04e785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:40.936499 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0f0c-3b4e-40be-8f66-ba5dbf04e785 admin admin] PATH_INFO: `/v3/projects/b49b8fc1d59d4f2f8a0319bfa479ab56/users/82cd6e3ab1b44082afa6caa598876836/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:40.953139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0f0c-3b4e-40be-8f66-ba5dbf04e785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49b8fc1d59d4f2f8a0319bfa479ab56, user_id=82cd6e3ab1b44082afa6caa598876836, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:40.956800 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0f0c-3b4e-40be-8f66-ba5dbf04e785 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.048703 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1372/2754] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:40 2022] PUT /identity/v3/projects/b49b8fc1d59d4f2f8a0319bfa479ab56/users/82cd6e3ab1b44082afa6caa598876836/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:41.056264 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45c180d632e41cdb97880086d7705c2', 'request_id': 'req-aa44c5de-d926-4956-8c0f-3b3c6a66db61'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.058734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.059021 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.059293 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.084526 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] MFA Rules not processed for user `82cd6e3ab1b44082afa6caa598876836`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:41.086420 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:41.151495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1373/2755] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:45:41.152238 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45c180d632e41cdb97880086d7705c2', 'request_id': 'req-aa44c5de-d926-4956-8c0f-3b3c6a66db61'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.157074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.162680 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45c180d632e41cdb97880086d7705c2', 'request_id': 'req-aa44c5de-d926-4956-8c0f-3b3c6a66db61'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.176631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] The token cache is being invalidate because project e45c180d632e41cdb97880086d7705c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:41.177268 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.178425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.180255 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1383/2756] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:40 2022] DELETE /identity/v3/projects/e45c180d632e41cdb97880086d7705c2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:41.184372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.186069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:41.223212 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558d96f-73c8-409e-ab7a-5d0ef1281735 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.228142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.229358 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.230027 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.230555 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] PATH_INFO: `/v3/projects` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.231620 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.234152 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.254762 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44c5de-d926-4956-8c0f-3b3c6a66db61 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.259830 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.260702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.260981 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.261252 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] PATH_INFO: `/v3/users/e95a39786f414c7797d2fdb55cb78c64` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.262530 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95a39786f414c7797d2fdb55cb78c64)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.264474 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.435554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1374/2757] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:41 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:41.439965 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.441773 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:41.506618 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ddd52-2d4e-44d5-b150-fc746b58d080 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.511537 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.512230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.512511 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.512778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.513510 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.515428 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.586043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95a39786f414c7797d2fdb55cb78c64'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.592645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95a39786f414c7797d2fdb55cb78c64'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.593316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95a39786f414c7797d2fdb55cb78c64'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.593909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95a39786f414c7797d2fdb55cb78c64'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.606171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95a39786f414c7797d2fdb55cb78c64'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:41.611632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1375/2758] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:41 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:41.615709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.621038 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:41.630690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397abf58-8e64-4ed7-839b-492bd670ed17 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.635401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.636063 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.636339 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.636616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.637390 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.639055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.650494 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1376/2759] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:45:41.654673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.665587 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baefff-b359-4ac5-a055-2188a6c1d7cc admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.670693 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.674763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.674763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.674763 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] PATH_INFO: `/v3/projects/4744bb5c51764707812de1ce3a892b56/users/5df011318a3b442ca207d1c74e93b3db/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.688776 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4744bb5c51764707812de1ce3a892b56, user_id=5df011318a3b442ca207d1c74e93b3db, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.691328 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.707030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1384/2760] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:41 2022] DELETE /identity/v3/users/e95a39786f414c7797d2fdb55cb78c64 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:41.783829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1377/2761] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:41 2022] PUT /identity/v3/projects/4744bb5c51764707812de1ce3a892b56/users/5df011318a3b442ca207d1c74e93b3db/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:41.787975 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.861799 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5d3f-95fd-4cf4-b38a-a83d71f939c4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.919643 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8aa1-28c6-414b-a072-63accb8c426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.920315 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8aa1-28c6-414b-a072-63accb8c426f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.920599 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8aa1-28c6-414b-a072-63accb8c426f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.920875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8aa1-28c6-414b-a072-63accb8c426f admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.921615 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8aa1-28c6-414b-a072-63accb8c426f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.923989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8aa1-28c6-414b-a072-63accb8c426f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.934322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1385/2762] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:41.939003 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:41.949556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0c1aa-0468-4505-a5b5-3826af29ef4b admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:41.955406 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:41.956374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.959523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.959523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] PATH_INFO: `/v3/projects/4744bb5c51764707812de1ce3a892b56/users/5df011318a3b442ca207d1c74e93b3db/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:41.959523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4744bb5c51764707812de1ce3a892b56, user_id=5df011318a3b442ca207d1c74e93b3db, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:41.961667 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:41.975514 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1378/2763] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:41 2022] PUT /identity/v3/projects/4744bb5c51764707812de1ce3a892b56/users/5df011318a3b442ca207d1c74e93b3db/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:41.987349 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:41.987911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:41.987911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:42.003362 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:42.005141 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:42.016612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] MFA Rules not processed for user `5df011318a3b442ca207d1c74e93b3db`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:42.017829 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:42.080439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea60cd9-2730-4dd4-856b-b3aa152b6996 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:42.085883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:42.087954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:42.094972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:42.094972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] PATH_INFO: `/v3/projects/a00e0863a4a9437aad4c9fae5ecc92c8` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:42.094972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00e0863a4a9437aad4c9fae5ecc92c8)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:42.094972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:42.098273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1386/2764] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:42.108380 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:42.110576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:42.180819 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d33e-3869-4e44-8e9b-ce8b3b44d3f1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:42.185543 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:42.186468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:42.186843 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:42.187121 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:42.200314 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:42.202273 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:42.223172 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1387/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:45:42.303067 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00e0863a4a9437aad4c9fae5ecc92c8', 'request_id': 'req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:42.409231 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00e0863a4a9437aad4c9fae5ecc92c8', 'request_id': 'req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:42.416771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00e0863a4a9437aad4c9fae5ecc92c8', 'request_id': 'req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:42.430904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] The token cache is being invalidate because project a00e0863a4a9437aad4c9fae5ecc92c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:42.431269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:42.432077 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:42.433814 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1379/2766] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:42 2022] DELETE /identity/v3/projects/a00e0863a4a9437aad4c9fae5ecc92c8 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:43.479014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:43.480390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:43.491865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b28227-5abf-4c68-a319-9d63fc35418a service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:43.541454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:43.542090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:43.542402 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:43.542678 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:43.544442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:43.601339 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:43.602736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:43.611557 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1388/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:48.836685 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:48.838424 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:48.915565 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe9ec-1fbc-4ca4-afc8-8620fe7fcb8a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:48.920218 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:48.921085 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:48.921608 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:48.922046 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] PATH_INFO: `/v3/users/b4a7807d1296434fbaac9b1f2dc9ba0f` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:48.924033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a7807d1296434fbaac9b1f2dc9ba0f)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:48.925962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:48.968696 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:48.969645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:48.981251 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010a6b9-c13b-4276-b1d0-75a7a341f629 service cinder] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:48.987111 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:48.987755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:48.988034 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:48.988308 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:48.990292 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:49.050866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:49.052332 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aef616-fb3c-4523-9e36-b391e7407903 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:49.061371 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1389/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:45:49.248571 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a7807d1296434fbaac9b1f2dc9ba0f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:49.260353 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a7807d1296434fbaac9b1f2dc9ba0f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:49.261022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a7807d1296434fbaac9b1f2dc9ba0f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:49.267660 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a7807d1296434fbaac9b1f2dc9ba0f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:49.391382 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a7807d1296434fbaac9b1f2dc9ba0f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:49.397879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1380/2769] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:48 2022] DELETE /identity/v3/users/b4a7807d1296434fbaac9b1f2dc9ba0f => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:49.402580 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:49.402865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:49.403142 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:49.421617 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:49.423515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:49.481155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1390/2770] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:49.491902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:49.496388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:49.554728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994deba-d19b-401d-899c-fdeeb1c40651 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:49.558457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295788e-885d-4d9a-a44d-e97891c6cca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:49.559137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295788e-885d-4d9a-a44d-e97891c6cca0 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:49.559417 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295788e-885d-4d9a-a44d-e97891c6cca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:49.559689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295788e-885d-4d9a-a44d-e97891c6cca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:49.569523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295788e-885d-4d9a-a44d-e97891c6cca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:49.571176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295788e-885d-4d9a-a44d-e97891c6cca0 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:49.581227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1381/2771] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:50.075652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.077231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:50.090267 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376f576-4519-4781-bee3-453f37d1a478 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.095737 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:50.096707 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.097056 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.097405 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] PATH_INFO: `/v3/projects/6c6f9e8ac2d64eccb59ca3a425925216` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.098756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6f9e8ac2d64eccb59ca3a425925216)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:50.100779 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:50.246669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6f9e8ac2d64eccb59ca3a425925216', 'request_id': 'req-c5c73c74-65b7-4885-bddf-56bcf349ecb4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:50.371404 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6f9e8ac2d64eccb59ca3a425925216', 'request_id': 'req-c5c73c74-65b7-4885-bddf-56bcf349ecb4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:50.379064 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6f9e8ac2d64eccb59ca3a425925216', 'request_id': 'req-c5c73c74-65b7-4885-bddf-56bcf349ecb4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:50.389344 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] The token cache is being invalidate because project 6c6f9e8ac2d64eccb59ca3a425925216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:50.389628 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:50.390425 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-c5c73c74-65b7-4885-bddf-56bcf349ecb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:50.391996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1391/2772] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:50 2022] DELETE /identity/v3/projects/6c6f9e8ac2d64eccb59ca3a425925216 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:50.397841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.398423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.398423 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.416470 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:50.417658 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:50.477215 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1382/2773] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:50.485636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.485998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.486319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.510118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:50.510283 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:50.518935 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1392/2774] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:50.523531 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.534054 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486976e3-5244-49e0-b7bf-8e29d41377ff None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.538911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:50.539562 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.539845 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.540132 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.540886 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:45:50.541193 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:50.542867 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:50.554808 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1383/2775] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:45:50.559396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.570342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125a83-6688-4bf5-a624-eb217528ded1 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.575399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:50.576081 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.576364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.576642 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.577384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:50.580581 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:50.713528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1393/2776] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:50 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:50.717821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.728334 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab05ca-ec6a-4150-80aa-0c5de265ff31 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.791790 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:50.792460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.792741 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.793013 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.793734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:50.795694 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:50.905904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1384/2777] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:50 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:50.910442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.923182 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3a32-11b5-49ef-b9e2-cdf94b0759f1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.925699 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:50.926395 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.926734 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.926942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.927719 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:50.929340 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:50.944523 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1394/2778] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:50.945520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.957388 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30f560-47fe-4a84-a632-0ebb2233106d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.962749 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f433-a68b-4f88-8ddd-0b8370593b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:50.963395 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f433-a68b-4f88-8ddd-0b8370593b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:50.963734 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f433-a68b-4f88-8ddd-0b8370593b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:50.963950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f433-a68b-4f88-8ddd-0b8370593b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:50.964691 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f433-a68b-4f88-8ddd-0b8370593b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:50.966377 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f433-a68b-4f88-8ddd-0b8370593b73 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:50.977536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1385/2779] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:50.981947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:50.993468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bfcfa-e470-4a2f-b1ed-cd84a4d70c07 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:50.999059 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:51.000068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.000864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.001226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] PATH_INFO: `/v3/projects/35f51cacac8340a393a3a179953e1626/users/936f15f308764da1ae287d57d5ad806f/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.018985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f51cacac8340a393a3a179953e1626, user_id=936f15f308764da1ae287d57d5ad806f, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:51.021812 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:51.114577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1395/2780] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:50 2022] PUT /identity/v3/projects/35f51cacac8340a393a3a179953e1626/users/936f15f308764da1ae287d57d5ad806f/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:51.126513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.126940 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.127216 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.156460 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] MFA Rules not processed for user `936f15f308764da1ae287d57d5ad806f`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:51.157837 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:51.222326 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1386/2781] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:45:51.233226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:51.299679 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d2a49-a6c2-41c7-b428-1e8afc20d2da admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:51.304804 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:51.305471 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.305757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.306039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.306781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:51.308697 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:51.450848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1396/2782] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:51 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:51.458146 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:51.469047 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be434922-56b0-475c-a07c-a6b1cca43c4c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:51.526975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:51.527652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.527934 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.528227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.528972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:51.530949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:51.659181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1387/2783] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:51 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:51.664508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:51.676038 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bc0e8-d10a-49a0-a55e-d0d47cd00262 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:51.680709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:51.681465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.681749 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.682025 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.682805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:51.684409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:51.698848 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1397/2784] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:51.703082 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:51.714542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655a6a-120c-4e26-b29a-98cbea656404 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:51.718899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b80250-5954-4720-abf5-3d1e30e358dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:51.720096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80250-5954-4720-abf5-3d1e30e358dc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.720371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80250-5954-4720-abf5-3d1e30e358dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.720639 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b80250-5954-4720-abf5-3d1e30e358dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.721365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80250-5954-4720-abf5-3d1e30e358dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:51.723055 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b80250-5954-4720-abf5-3d1e30e358dc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:51.733058 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1388/2785] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:51.738093 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:51.748174 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f999e-cf0b-4dca-b233-eabe48de464f admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:51.753070 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:51.753943 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.754241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.754532 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] PATH_INFO: `/v3/projects/d9d00b0dbb3849baaa06e10059def109/users/332dbf26ed3e4c3a95613d88a69c75e7/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.771640 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d00b0dbb3849baaa06e10059def109, user_id=332dbf26ed3e4c3a95613d88a69c75e7, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:51.773345 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:51.934726 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1398/2786] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:51 2022] PUT /identity/v3/projects/d9d00b0dbb3849baaa06e10059def109/users/332dbf26ed3e4c3a95613d88a69c75e7/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:51.946204 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:51.946519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:51.946796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:51.976403 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] MFA Rules not processed for user `332dbf26ed3e4c3a95613d88a69c75e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:51.977616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:52.051012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1389/2787] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:52.055490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:52.249301 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459146-d8f2-49ab-8fc9-bd1d5287b4d1 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:52.254614 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:52.255274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.255555 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.255828 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.256521 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:52.258442 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:52.389896 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1399/2788] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:52 2022] POST /identity/v3/projects => generated 377 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:52.394716 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:52.405529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885a958-3bc8-4a2f-a4f1-c56586aa45b6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:52.467310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:52.468024 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.468245 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.468515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.469265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:52.471288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:52.589294 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1390/2789] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:52 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:52.593043 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:52.603365 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4fd4-edef-4dfd-88ba-8e4cb5416ce4 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:52.608265 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:52.608921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.609201 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.609476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.610384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:52.611978 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:52.622232 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1400/2790] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:52.627243 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:52.638701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0f3f-5225-4289-ad02-b13ba35bde2e admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:52.644088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:52.644971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.649453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.649453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] PATH_INFO: `/v3/projects/e04a48c1fb624e808b2dae88d8789e04/users/4edf1bbf9a4c4b48afa16e642b6eba3d/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.660705 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04a48c1fb624e808b2dae88d8789e04, user_id=4edf1bbf9a4c4b48afa16e642b6eba3d, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:52.663509 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:52.788807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1391/2791] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:52 2022] PUT /identity/v3/projects/e04a48c1fb624e808b2dae88d8789e04/users/4edf1bbf9a4c4b48afa16e642b6eba3d/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:52.792944 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:52.803841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a9a74-1253-4935-94f2-7a077d7a168a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:52.859279 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01416-b986-4ff4-824c-f7b3e3c6c27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:52.860353 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01416-b986-4ff4-824c-f7b3e3c6c27c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.860682 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01416-b986-4ff4-824c-f7b3e3c6c27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.860914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01416-b986-4ff4-824c-f7b3e3c6c27c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.861810 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01416-b986-4ff4-824c-f7b3e3c6c27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:52.863476 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c01416-b986-4ff4-824c-f7b3e3c6c27c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:52.874938 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1401/2792] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:52.879668 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:52.890185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf00206-6eae-451d-b42e-e9dc0a7758a0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:52.895148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:52.896154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.896438 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.896717 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] PATH_INFO: `/v3/projects/e04a48c1fb624e808b2dae88d8789e04/users/4edf1bbf9a4c4b48afa16e642b6eba3d/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.898757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04a48c1fb624e808b2dae88d8789e04, user_id=4edf1bbf9a4c4b48afa16e642b6eba3d, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:52.901478 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:52.912365 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1392/2793] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:52 2022] PUT /identity/v3/projects/e04a48c1fb624e808b2dae88d8789e04/users/4edf1bbf9a4c4b48afa16e642b6eba3d/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:52.923233 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:52.923559 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:52.923880 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:52.950079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] MFA Rules not processed for user `4edf1bbf9a4c4b48afa16e642b6eba3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:52.951319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:53.019336 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1402/2794] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:53.030458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:53.032662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:53.089863 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c31f4-dec2-4909-bc0e-c08971aa971c admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:53.093579 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30011-d0c3-45f3-8499-408336eebd9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:53.095028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30011-d0c3-45f3-8499-408336eebd9b service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:53.095318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30011-d0c3-45f3-8499-408336eebd9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:53.095720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30011-d0c3-45f3-8499-408336eebd9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:53.151786 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30011-d0c3-45f3-8499-408336eebd9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:53.153183 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f30011-d0c3-45f3-8499-408336eebd9b service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:53.162728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1393/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:53.725434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:53.726863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:53.790560 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000bc1-38ec-4ccd-8589-f8c742550565 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:53.795492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:53.796455 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:53.796808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:53.797151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] PATH_INFO: `/v3/users/ced6ad5fcaf24446a1996f4cf34b6ef0` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:53.798693 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced6ad5fcaf24446a1996f4cf34b6ef0)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:53.800641 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:54.058525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced6ad5fcaf24446a1996f4cf34b6ef0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:54.065456 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced6ad5fcaf24446a1996f4cf34b6ef0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:54.066115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced6ad5fcaf24446a1996f4cf34b6ef0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:54.066805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced6ad5fcaf24446a1996f4cf34b6ef0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:54.079801 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced6ad5fcaf24446a1996f4cf34b6ef0'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:54.211381 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1403/2796] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:53 2022] DELETE /identity/v3/users/ced6ad5fcaf24446a1996f4cf34b6ef0 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:54.216051 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:54.216521 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:54.216635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:54.233518 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:54.234769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:54.297271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1394/2797] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:54.308519 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:54.309997 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:54.374461 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b7ee8-8827-43de-98ef-7013df7496e6 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:54.379079 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:54.379757 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:54.380035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:54.380382 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:54.390098 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:54.393069 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:54.402584 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1404/2798] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:54.911348 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:54.912754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:54.930778 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594dc9-671b-48c6-843e-d8b415c048e7 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:54.935841 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:54.936871 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:54.937806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:54.937806 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] PATH_INFO: `/v3/projects/0fc93cc5053a480da6a9bad48173010c` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:54.939214 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc93cc5053a480da6a9bad48173010c)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:54.941578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:55.066359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc93cc5053a480da6a9bad48173010c', 'request_id': 'req-ddcdf78b-7150-4f33-9c76-1e91f0359237'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.145632 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc93cc5053a480da6a9bad48173010c', 'request_id': 'req-ddcdf78b-7150-4f33-9c76-1e91f0359237'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.151846 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc93cc5053a480da6a9bad48173010c', 'request_id': 'req-ddcdf78b-7150-4f33-9c76-1e91f0359237'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.163434 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] The token cache is being invalidate because project 0fc93cc5053a480da6a9bad48173010c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:55.166516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.166516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.166516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1395/2799] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:54 2022] DELETE /identity/v3/projects/0fc93cc5053a480da6a9bad48173010c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:55.169861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:55.179998 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139612e-63b5-40ca-8681-19d675e68520 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:55.213516 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:55.214998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:55.241218 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:55.242083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:55.242415 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:55.242656 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] PATH_INFO: `/v3/users/82cd6e3ab1b44082afa6caa598876836` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:55.243886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cd6e3ab1b44082afa6caa598876836)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:55.245837 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:55.274432 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf78b-7150-4f33-9c76-1e91f0359237 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:55.278040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:55.278708 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:55.288285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:55.288285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:55.288285 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:55.340801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:55.342247 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:55.351829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1396/2800] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:45:55.516443 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cd6e3ab1b44082afa6caa598876836'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.523383 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cd6e3ab1b44082afa6caa598876836'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.524080 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cd6e3ab1b44082afa6caa598876836'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.524701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cd6e3ab1b44082afa6caa598876836'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.537073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cd6e3ab1b44082afa6caa598876836'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:55.657840 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1405/2801] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:55 2022] DELETE /identity/v3/users/82cd6e3ab1b44082afa6caa598876836 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:56.115919 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:56.117363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:56.133374 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bda156-596e-468b-8078-f40b5cbe6086 service cinder] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:56.192513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:56.193363 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:56.193635 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:56.193904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] PATH_INFO: `/v3/projects/b49b8fc1d59d4f2f8a0319bfa479ab56` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:56.195142 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49b8fc1d59d4f2f8a0319bfa479ab56)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:56.197100 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:56.454715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49b8fc1d59d4f2f8a0319bfa479ab56', 'request_id': 'req-32c33645-920f-43d1-a5b7-39f37973fe84'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.560286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49b8fc1d59d4f2f8a0319bfa479ab56', 'request_id': 'req-32c33645-920f-43d1-a5b7-39f37973fe84'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.568087 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49b8fc1d59d4f2f8a0319bfa479ab56', 'request_id': 'req-32c33645-920f-43d1-a5b7-39f37973fe84'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.579721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] The token cache is being invalidate because project b49b8fc1d59d4f2f8a0319bfa479ab56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:56.580033 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.580711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.582917 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1397/2802] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:56 2022] DELETE /identity/v3/projects/b49b8fc1d59d4f2f8a0319bfa479ab56 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:56.586782 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:56.588208 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:56.601635 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908ec90-a505-4915-bf5b-f92ae9bfb162 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:56.657874 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:56.658756 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:56.659030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:56.659295 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] PATH_INFO: `/v3/users/5df011318a3b442ca207d1c74e93b3db` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:56.660501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df011318a3b442ca207d1c74e93b3db)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:56.662431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:56.870512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df011318a3b442ca207d1c74e93b3db'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.877881 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df011318a3b442ca207d1c74e93b3db'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.878611 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df011318a3b442ca207d1c74e93b3db'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.879231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df011318a3b442ca207d1c74e93b3db'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.890817 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df011318a3b442ca207d1c74e93b3db'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:56.977359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1406/2803] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:56 2022] DELETE /identity/v3/users/5df011318a3b442ca207d1c74e93b3db => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:57.138508 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:57.139879 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:57.200411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33645-920f-43d1-a5b7-39f37973fe84 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:57.251209 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:57.251883 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:57.252163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:57.252431 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:57.254469 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:57.317909 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:57.319534 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5ca49-01d0-4591-be15-257d85e75f56 service cinder] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:57.330144 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1398/2804] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:57.484947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:57.484947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:57.551645 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66afcc-abbb-4871-8845-d0d34aaa3317 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:57.556304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:57.557304 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:57.557585 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:57.557886 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] PATH_INFO: `/v3/projects/4744bb5c51764707812de1ce3a892b56` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:57.559120 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4744bb5c51764707812de1ce3a892b56)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:57.561013 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:57.695035 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4744bb5c51764707812de1ce3a892b56', 'request_id': 'req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:57.754976 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4744bb5c51764707812de1ce3a892b56', 'request_id': 'req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:57.765952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4744bb5c51764707812de1ce3a892b56', 'request_id': 'req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:57.777305 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] The token cache is being invalidate because project 4744bb5c51764707812de1ce3a892b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:45:57.777592 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:57.778310 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-bfb3f6b7-c8bc-40e6-b169-16bffa45e28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:57.782441 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1407/2805] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:57 2022] DELETE /identity/v3/projects/4744bb5c51764707812de1ce3a892b56 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:57.790564 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:57.791253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:57.791253 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:57.809986 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:57.811240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:57.870471 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1399/2806] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:57.880179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:57.880468 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:57.880945 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:57.899963 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:57.901188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:57.910277 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1408/2807] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:57.914699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:57.927852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99328f-bed4-4b82-80d7-10a77ba5b6cb None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:57.932652 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:57.933297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:57.933578 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:57.933854 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:57.934631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:45:57.934939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:57.936556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:57.949532 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1400/2808] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:45:57.953921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:57.963083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf9a9-8702-44a4-8131-f95c3e5115a6 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:57.967746 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:57.968386 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:57.968667 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:57.968947 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:57.969766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:57.971977 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:58.056147 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1409/2809] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:45:57 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:45:58.061040 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:58.072279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6835f-a9f6-4535-9f23-49daea4c5bd7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:58.131547 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:58.132278 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.132558 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.132833 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.133541 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:58.135504 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:58.249426 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1401/2810] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:45:58 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:45:58.257422 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:58.268082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a621f-8101-4f47-bd72-bad85b6860f9 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:58.272670 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:58.273318 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.273594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.273863 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.275367 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:58.276342 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:58.287465 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1410/2811] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:58.291894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:58.302759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c690b-f92f-4122-9069-d95734d56393 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:58.307427 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b64c-3b3c-4475-b463-a09c08f72ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:58.308074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b64c-3b3c-4475-b463-a09c08f72ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.308357 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b64c-3b3c-4475-b463-a09c08f72ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.316760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b64c-3b3c-4475-b463-a09c08f72ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.316760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b64c-3b3c-4475-b463-a09c08f72ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:58.316760 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b64c-3b3c-4475-b463-a09c08f72ecc admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:58.322489 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1402/2812] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:45:58.326729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:58.336883 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be7265-de7d-4726-be5d-f4430e82b184 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:58.341480 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:58.342374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.342658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.342932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] PATH_INFO: `/v3/projects/6c41e1cd1cf8444cbe3ddff146090dd3/users/45dc224dd0c349cfb46fbc733996f4d5/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.357668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c41e1cd1cf8444cbe3ddff146090dd3, user_id=45dc224dd0c349cfb46fbc733996f4d5, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:58.361054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:58.468816 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1411/2813] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:45:58 2022] PUT /identity/v3/projects/6c41e1cd1cf8444cbe3ddff146090dd3/users/45dc224dd0c349cfb46fbc733996f4d5/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:45:58.494076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.494512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.494801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.526371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] MFA Rules not processed for user `45dc224dd0c349cfb46fbc733996f4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:58.527498 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:58.600877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1403/2814] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:45:58.612162 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:58.614004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:58.672578 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0b90-6c84-41a7-92b9-c41988a9dd2b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:58.677374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03d4ce-868b-4ee1-b165-9821d020b42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:58.678023 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d4ce-868b-4ee1-b165-9821d020b42e service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.678346 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d4ce-868b-4ee1-b165-9821d020b42e service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.678651 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d4ce-868b-4ee1-b165-9821d020b42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.687971 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d4ce-868b-4ee1-b165-9821d020b42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:58.689720 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d4ce-868b-4ee1-b165-9821d020b42e service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:58.700805 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1412/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:58.722839 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:58.790187 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2c6e5-533b-4f2b-bd79-b63bd125ef84 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:58.794999 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:58.795813 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:58.796089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:58.796359 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] PATH_INFO: `/v3/users/45dc224dd0c349cfb46fbc733996f4d5` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:58.797665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=45dc224dd0c349cfb46fbc733996f4d5)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:58.799835 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:59.042049 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45dc224dd0c349cfb46fbc733996f4d5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:59.053994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45dc224dd0c349cfb46fbc733996f4d5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:59.054700 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45dc224dd0c349cfb46fbc733996f4d5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:59.061324 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45dc224dd0c349cfb46fbc733996f4d5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:59.154852 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45dc224dd0c349cfb46fbc733996f4d5'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:45:59.161812 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1404/2816] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:45:58 2022] DELETE /identity/v3/users/45dc224dd0c349cfb46fbc733996f4d5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:45:59.166683 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:59.166974 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:59.167253 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:59.185631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:45:59.186893 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:59.254962 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1413/2817] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:45:59.264876 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:59.267036 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:59.326492 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ad307-3895-44bc-9ed8-555afe81e5ed admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:59.330901 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d717cbe-581a-485d-b151-e0f412eb1c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:59.331630 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d717cbe-581a-485d-b151-e0f412eb1c91 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:59.331911 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d717cbe-581a-485d-b151-e0f412eb1c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:59.332286 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d717cbe-581a-485d-b151-e0f412eb1c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:59.341962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d717cbe-581a-485d-b151-e0f412eb1c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:59.343468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d717cbe-581a-485d-b151-e0f412eb1c91 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:59.356122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1405/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:45:59.807577 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:45:59.809271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:45:59.823168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464969a-5133-4958-84a3-f3e8b861c0c8 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:45:59.830298 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:45:59.831231 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:45:59.831510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:45:59.831785 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] PATH_INFO: `/v3/projects/6c41e1cd1cf8444cbe3ddff146090dd3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:45:59.833102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c41e1cd1cf8444cbe3ddff146090dd3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:45:59.835014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:45:59.964109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c41e1cd1cf8444cbe3ddff146090dd3', 'request_id': 'req-9a57819b-53a8-4dc5-8029-d3e0a9e72942'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:00.037594 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c41e1cd1cf8444cbe3ddff146090dd3', 'request_id': 'req-9a57819b-53a8-4dc5-8029-d3e0a9e72942'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:00.044243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c41e1cd1cf8444cbe3ddff146090dd3', 'request_id': 'req-9a57819b-53a8-4dc5-8029-d3e0a9e72942'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:00.054823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] The token cache is being invalidate because project 6c41e1cd1cf8444cbe3ddff146090dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:46:00.055114 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:00.055791 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-9a57819b-53a8-4dc5-8029-d3e0a9e72942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:00.057319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1414/2819] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:45:59 2022] DELETE /identity/v3/projects/6c41e1cd1cf8444cbe3ddff146090dd3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:00.063935 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.064449 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.064551 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.083059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:00.084174 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:00.143175 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1406/2820] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:00.151668 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.152243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.152363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.171217 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:00.172436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:00.181005 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1415/2821] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:00.185318 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.195663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205003-8367-4b64-bfa5-3dea9a38027c None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.200266 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.200913 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.201191 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.201461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.202189 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:46:00.202519 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.204336 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.216953 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1407/2822] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:46:00.221294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.230855 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2395c-aa80-47c0-bd77-d1632f36a5d9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.236014 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.236747 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.237019 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.237294 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.238004 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.239942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.358200 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1416/2823] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:46:00 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:46:00.361719 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.372127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e8ae2-5640-4ee8-8c62-075f33f827e5 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.441211 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.441794 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.442080 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.442397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.443104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.445126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.538633 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1408/2824] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:46:00 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:46:00.542989 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.554967 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99b2e-01c6-4a8f-b3a1-230268780c6a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.571558 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.572243 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.575681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.575681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.575681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.575681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.589745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1417/2825] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:46:00.591472 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.602770 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dc432-a215-434d-aea0-8f6354fc8c12 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.607606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616b356-53f6-4d84-b36f-a0a1bad707bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.608384 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b356-53f6-4d84-b36f-a0a1bad707bd admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.608606 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b356-53f6-4d84-b36f-a0a1bad707bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.608994 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b356-53f6-4d84-b36f-a0a1bad707bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.609728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616b356-53f6-4d84-b36f-a0a1bad707bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.612060 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616b356-53f6-4d84-b36f-a0a1bad707bd admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.622972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1409/2826] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:46:00.627180 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.637009 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf266a-ba43-4b5b-8daf-9da9c0f6a062 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.642074 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.643188 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.643467 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.643857 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] PATH_INFO: `/v3/projects/77459867f2ca40c6aac9eebdcfed7ca2/users/170dcc817fa34bc781ffe7fedf729b88/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.662140 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77459867f2ca40c6aac9eebdcfed7ca2, user_id=170dcc817fa34bc781ffe7fedf729b88, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.664941 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.796437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1418/2827] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:46:00 2022] PUT /identity/v3/projects/77459867f2ca40c6aac9eebdcfed7ca2/users/170dcc817fa34bc781ffe7fedf729b88/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:00.802952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.803250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.803556 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.822099 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:00.823341 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:00.886236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1410/2828] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:46:00.898130 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:00.899914 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:00.959269 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d25c-090d-4cfa-9456-eab17fb56a8b admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:00.963123 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c342-4c4b-419c-b8cc-e84e09fea730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:00.963759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c342-4c4b-419c-b8cc-e84e09fea730 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:00.967330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c342-4c4b-419c-b8cc-e84e09fea730 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:00.967330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c342-4c4b-419c-b8cc-e84e09fea730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:00.974575 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048c342-4c4b-419c-b8cc-e84e09fea730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:00.975996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048c342-4c4b-419c-b8cc-e84e09fea730 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:00.985351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1419/2829] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:46:02.322053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:02.329774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:02.336269 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631605be-2d68-4da9-ada0-0f6fd3315ef2 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:02.341435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:02.341435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:02.341435 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:02.347093 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:02.348094 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:02.348464 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:02.348801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] PATH_INFO: `/v3/users/936f15f308764da1ae287d57d5ad806f` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:02.350227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] RBAC: Authorizing `identity:delete_user(user_id=936f15f308764da1ae287d57d5ad806f)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:02.352864 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:02.370183 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] MFA Rules not processed for user `170dcc817fa34bc781ffe7fedf729b88`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:02.371409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:02.450262 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1420/2830] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:02.460973 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:02.462376 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:02.521061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c003d-de89-4f15-a9e6-35c57849f666 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:02.524704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e8d2a-9641-46ea-83ce-b595d1007de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:02.525341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e8d2a-9641-46ea-83ce-b595d1007de3 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:02.525695 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e8d2a-9641-46ea-83ce-b595d1007de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:02.525921 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e8d2a-9641-46ea-83ce-b595d1007de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:02.534901 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e8d2a-9641-46ea-83ce-b595d1007de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:02.536323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e8d2a-9641-46ea-83ce-b595d1007de3 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:02.544900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1421/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:46:02.565777 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936f15f308764da1ae287d57d5ad806f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:02.578148 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936f15f308764da1ae287d57d5ad806f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:02.580129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936f15f308764da1ae287d57d5ad806f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:02.591710 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936f15f308764da1ae287d57d5ad806f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:02.651401 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936f15f308764da1ae287d57d5ad806f'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:02.659807 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1411/2832] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:46:02 2022] DELETE /identity/v3/users/936f15f308764da1ae287d57d5ad806f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:02.664364 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:02.664654 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:02.666808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:02.683166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:02.684361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:02.740813 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1422/2833] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:02.751091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:02.752698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:02.809698 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bade32-8c34-4b97-abf8-fb1a369a767d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:02.813178 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:02.814584 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:02.814874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:02.815127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:02.824156 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:02.825593 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:02.835787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1412/2834] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:46:03.223299 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:03.224866 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:03.249351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bb11c-02de-4d7e-87de-c18f156220de None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:03.259155 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:03.260118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:03.260363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:03.260691 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] PATH_INFO: `/v3/projects/35f51cacac8340a393a3a179953e1626` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:03.261954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f51cacac8340a393a3a179953e1626)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:03.263900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:03.417381 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f51cacac8340a393a3a179953e1626', 'request_id': 'req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.497316 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f51cacac8340a393a3a179953e1626', 'request_id': 'req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.505006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f51cacac8340a393a3a179953e1626', 'request_id': 'req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.517092 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] The token cache is being invalidate because project 35f51cacac8340a393a3a179953e1626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:46:03.517424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.518006 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-eef0676e-d892-4a5a-9aa6-f235a0b9ae97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.519565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1423/2835] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:46:03 2022] DELETE /identity/v3/projects/35f51cacac8340a393a3a179953e1626 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:03.523722 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:03.534899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c5092-a39d-40a1-a3da-81a2a1f4413f service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:03.591173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:03.591942 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:03.592222 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:03.592495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] PATH_INFO: `/v3/users/332dbf26ed3e4c3a95613d88a69c75e7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:03.593689 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=332dbf26ed3e4c3a95613d88a69c75e7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:03.595759 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:03.817497 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332dbf26ed3e4c3a95613d88a69c75e7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.828898 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332dbf26ed3e4c3a95613d88a69c75e7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.830176 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332dbf26ed3e4c3a95613d88a69c75e7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.836779 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332dbf26ed3e4c3a95613d88a69c75e7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.924076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332dbf26ed3e4c3a95613d88a69c75e7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:03.930688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1413/2836] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:46:03 2022] DELETE /identity/v3/users/332dbf26ed3e4c3a95613d88a69c75e7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:04.318942 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:04.319234 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:04.319512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:04.337636 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] MFA Rules not processed for user `170dcc817fa34bc781ffe7fedf729b88`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:04.338865 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:04.379169 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:04.379690 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:04.395490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1424/2837] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:04.450888 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2567-f995-4763-8d53-a43f13edc6ff admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:04.456439 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:04.457397 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:04.457673 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:04.457943 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] PATH_INFO: `/v3/projects/d9d00b0dbb3849baaa06e10059def109` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:04.459237 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d00b0dbb3849baaa06e10059def109)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:04.461249 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:04.604688 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d00b0dbb3849baaa06e10059def109', 'request_id': 'req-12d333a6-c0d2-4a95-ae62-83863e222ee7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:04.645985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:04.648449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:04.702960 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc74d7-eda6-4cfb-a85b-c191378d31e4 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:04.706059 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d00b0dbb3849baaa06e10059def109', 'request_id': 'req-12d333a6-c0d2-4a95-ae62-83863e222ee7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:04.712088 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d00b0dbb3849baaa06e10059def109', 'request_id': 'req-12d333a6-c0d2-4a95-ae62-83863e222ee7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:04.724350 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] The token cache is being invalidate because project d9d00b0dbb3849baaa06e10059def109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79425) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:46:04.728536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:04.728536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:04.728536 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1414/2838] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:46:04 2022] DELETE /identity/v3/projects/d9d00b0dbb3849baaa06e10059def109 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:46:04.730975 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:04.732344 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:04.756095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:04.756793 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:04.757083 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:04.757357 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:04.759166 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:04.769388 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:04.770872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:04.779280 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1425/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:46:04.807379 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d333a6-c0d2-4a95-ae62-83863e222ee7 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:04.812084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:04.812952 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:04.813227 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:04.813592 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] PATH_INFO: `/v3/users/4edf1bbf9a4c4b48afa16e642b6eba3d` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:04.814921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edf1bbf9a4c4b48afa16e642b6eba3d)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:04.816851 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:05.017900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edf1bbf9a4c4b48afa16e642b6eba3d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.029900 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edf1bbf9a4c4b48afa16e642b6eba3d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.030669 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edf1bbf9a4c4b48afa16e642b6eba3d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.038197 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edf1bbf9a4c4b48afa16e642b6eba3d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.129109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-b343fc35-854f-45cf-9d65-21bee4dd35f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edf1bbf9a4c4b48afa16e642b6eba3d'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.136262 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1415/2840] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:46:04 2022] DELETE /identity/v3/users/4edf1bbf9a4c4b48afa16e642b6eba3d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:46:05.599961 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:05.611606 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c24a55-926e-4c50-b0d3-216c8cdd3726 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:05.686399 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:05.687274 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:05.687534 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:05.687806 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] PATH_INFO: `/v3/projects/e04a48c1fb624e808b2dae88d8789e04` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:05.689676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04a48c1fb624e808b2dae88d8789e04)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:05.691317 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:05.808736 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04a48c1fb624e808b2dae88d8789e04', 'request_id': 'req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.917602 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04a48c1fb624e808b2dae88d8789e04', 'request_id': 'req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.924888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04a48c1fb624e808b2dae88d8789e04', 'request_id': 'req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.935278 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] The token cache is being invalidate because project e04a48c1fb624e808b2dae88d8789e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:46:05.935589 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.936230 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-ff084b49-4fd0-4e59-818b-1b253b4d5ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:05.937758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1426/2841] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:46:05 2022] DELETE /identity/v3/projects/e04a48c1fb624e808b2dae88d8789e04 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:05.944832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:05.945538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:05.945538 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:05.964914 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:05.966355 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:06.030452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1416/2842] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:06.038417 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.038705 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.039002 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.058406 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:06.059671 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:06.068075 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1427/2843] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:06.072297 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.082533 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb898-d727-47bd-9a9b-730e3b760cec None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.087302 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.087958 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.088236 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.088623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.089351 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:46:06.089662 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.091301 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.103902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1417/2844] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:46:06.115323 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.124561 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8a80d-8cb0-4521-8c28-bdb022ff6118 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.130185 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.130861 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.131137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.131408 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.132109 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.133996 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.274727 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1428/2845] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:46:06 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:46:06.278824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.288601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47559d-b376-4c86-8380-2412f2794588 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.346850 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.347513 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.347793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.348069 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.348774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.350721 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.444461 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1418/2846] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:46:06 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:46:06.448608 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.458891 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc7b1c-05bc-4354-94fe-28215586ee72 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.463512 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.464161 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.464434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.464704 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.465440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.467062 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.477430 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1429/2847] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:46:06.481468 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.495798 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433366e-41cb-4d67-b678-1056cc42efd9 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.503998 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7803136-0c8b-4fca-8ea7-a4dee0432cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.504847 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7803136-0c8b-4fca-8ea7-a4dee0432cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.505137 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7803136-0c8b-4fca-8ea7-a4dee0432cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.505409 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7803136-0c8b-4fca-8ea7-a4dee0432cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.506149 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7803136-0c8b-4fca-8ea7-a4dee0432cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.507840 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7803136-0c8b-4fca-8ea7-a4dee0432cf9 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.518656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1419/2848] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:46:06.522904 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.533537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b733fdd-1544-4f8b-9903-09b37960ca2a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.538633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.539513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.539792 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.540065 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] PATH_INFO: `/v3/projects/2c5a88cbfcac44e499a4bed44997351f/users/4dfa295669b04117ba95827092be5f15/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.557479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5a88cbfcac44e499a4bed44997351f, user_id=4dfa295669b04117ba95827092be5f15, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.560171 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.681240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1430/2849] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:46:06 2022] PUT /identity/v3/projects/2c5a88cbfcac44e499a4bed44997351f/users/4dfa295669b04117ba95827092be5f15/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:06.692515 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.692805 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.693112 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.720284 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] MFA Rules not processed for user `4dfa295669b04117ba95827092be5f15`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:06.721445 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:06.788791 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1420/2850] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:06.799909 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:06.801576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:06.857501 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6c14-da4e-47ac-bcba-b4c23f8f63d0 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:06.862330 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ec763-a3b6-4915-bb41-80ad14039812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a04d0effd2d54f28af90ede3c495a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:06.863001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec763-a3b6-4915-bb41-80ad14039812 service cinder] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:06.863276 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec763-a3b6-4915-bb41-80ad14039812 service cinder] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:06.863547 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec763-a3b6-4915-bb41-80ad14039812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:06.872311 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ec763-a3b6-4915-bb41-80ad14039812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:06.875574 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ec763-a3b6-4915-bb41-80ad14039812 service cinder] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:06.883802 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1431/2851] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:46:53.666605 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:53.743542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a68f-34c9-4c00-ab7a-8d073d57cbc6 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:53.748962 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:53.750298 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:53.750829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:53.751310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] PATH_INFO: `/v3/users/4dfa295669b04117ba95827092be5f15` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:53.753677 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfa295669b04117ba95827092be5f15)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:53.758180 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:53.952711 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfa295669b04117ba95827092be5f15'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:53.968709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfa295669b04117ba95827092be5f15'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:53.968709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfa295669b04117ba95827092be5f15'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:53.979163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfa295669b04117ba95827092be5f15'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:54.087251 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfa295669b04117ba95827092be5f15'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:54.096907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1421/2852] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:46:53 2022] DELETE /identity/v3/users/4dfa295669b04117ba95827092be5f15 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:54.106730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:54.107661 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:54.107987 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:54.140396 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:54.142508 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:54.235788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1432/2853] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:54.251774 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:54.253288 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:54.338757 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340c84-1ce8-4d09-87ab-cd38faf17bcb admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:54.343109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e2bc-d873-485b-a6ad-8b7a0f17c974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:54.343822 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e2bc-d873-485b-a6ad-8b7a0f17c974 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:54.344143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e2bc-d873-485b-a6ad-8b7a0f17c974 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:54.344507 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e2bc-d873-485b-a6ad-8b7a0f17c974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:54.362801 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630e2bc-d873-485b-a6ad-8b7a0f17c974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:54.365771 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630e2bc-d873-485b-a6ad-8b7a0f17c974 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:54.384826 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1422/2854] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:46:54.970744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:54.972634 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:54.987529 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc2522-d1e4-4fbf-804e-a5c93d484278 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:54.994753 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:54.995845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:54.995845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:54.996151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] PATH_INFO: `/v3/projects/2c5a88cbfcac44e499a4bed44997351f` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:54.997922 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5a88cbfcac44e499a4bed44997351f)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:55.000673 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:55.169090 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5a88cbfcac44e499a4bed44997351f', 'request_id': 'req-7fc4c115-e566-4da5-a442-493dd7a20cc7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:55.252633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5a88cbfcac44e499a4bed44997351f', 'request_id': 'req-7fc4c115-e566-4da5-a442-493dd7a20cc7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:55.263021 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5a88cbfcac44e499a4bed44997351f', 'request_id': 'req-7fc4c115-e566-4da5-a442-493dd7a20cc7'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:55.278319 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] The token cache is being invalidate because project 2c5a88cbfcac44e499a4bed44997351f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:46:55.278831 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:55.280173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-7fc4c115-e566-4da5-a442-493dd7a20cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:46:55.282927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1433/2855] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:46:54 2022] DELETE /identity/v3/projects/2c5a88cbfcac44e499a4bed44997351f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:46:55.289936 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.290787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.290787 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.321590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:55.322972 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:55.423126 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1423/2856] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:55.432526 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.432808 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.433118 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.454790 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:55.456086 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:55.466350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1434/2857] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:46:55.471628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:55.487127 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b34764-ad53-4860-8c4f-5a34c9d8939f None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:55.494452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:55.495454 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.495875 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.496279 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] PATH_INFO: `/v3/domains` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.497275 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 11:46:55.497742 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:55.500173 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:55.521186 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1424/2858] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Jan 10 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 11:46:55.528281 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:55.541939 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efd57e-cd47-43d7-a580-378d4397ebd9 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:55.549864 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:55.550966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.551434 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.551894 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.553168 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:55.556927 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:55.676271 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1435/2859] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:46:55 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:46:55.683458 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:55.694485 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a75e47-2826-426f-b50f-40b414863088 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:55.771657 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:55.772271 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.772554 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.773400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.774138 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:55.776232 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:55.897070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1425/2860] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:46:55 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:46:55.903325 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:55.921492 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aa0d5-ebe5-4064-b6d6-139ddb89ea8a admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:55.929438 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:55.930633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.931124 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.931618 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.933020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:55.936436 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:55.957759 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1436/2861] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:46:55.962728 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:55.975145 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b849-dcbd-4b94-a361-1d3bc691dfc0 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:55.981623 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd85c1-0af0-4869-8ab4-87b7ed9a01e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:55.982337 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd85c1-0af0-4869-8ab4-87b7ed9a01e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:55.982641 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd85c1-0af0-4869-8ab4-87b7ed9a01e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:55.982894 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd85c1-0af0-4869-8ab4-87b7ed9a01e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:55.983642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd85c1-0af0-4869-8ab4-87b7ed9a01e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:55.985327 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd85c1-0af0-4869-8ab4-87b7ed9a01e4 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:56.002896 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1426/2862] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:46:56.007952 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:56.019702 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048e8e4-bb26-4c78-a7e1-4b2b13c2fe0c admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:56.026470 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:56.027549 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:56.028061 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:56.028525 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] PATH_INFO: `/v3/projects/3f1d77884a2a4a7ebb85ba71e9d864a7/users/fa0eed1277c2418ca9f815589ab58896/roles/c32977f9cff44544b097a3692528aa7c` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:56.051297 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1d77884a2a4a7ebb85ba71e9d864a7, user_id=fa0eed1277c2418ca9f815589ab58896, role_id=c32977f9cff44544b097a3692528aa7c)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:56.055745 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:56.151659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1437/2863] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:46:56 2022] PUT /identity/v3/projects/3f1d77884a2a4a7ebb85ba71e9d864a7/users/fa0eed1277c2418ca9f815589ab58896/roles/c32977f9cff44544b097a3692528aa7c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:46:56.158522 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e132-233a-4790-a544-9bf2e19aa8e6 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:56.159028 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e132-233a-4790-a544-9bf2e19aa8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:56.159527 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e132-233a-4790-a544-9bf2e19aa8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:56.192799 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-a314e132-233a-4790-a544-9bf2e19aa8e6 None None] MFA Rules not processed for user `bed62ab9bae84e5e97211f8e6376a1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:46:56.195912 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-a314e132-233a-4790-a544-9bf2e19aa8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:56.305874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1427/2864] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:46:56.318350 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:46:56.322016 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:46:56.389362 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd96a-fcca-4c68-8f58-a15fc8e90a73 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:46:56.393527 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:46:56.394189 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:46:56.394504 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:46:56.394787 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:46:56.405522 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:46:56.407030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:46:56.418688 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1438/2865] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:47:03.915125 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:03.915950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:03.916104 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:03.958057 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] MFA Rules not processed for user `fa0eed1277c2418ca9f815589ab58896`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:47:03.963718 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:04.095877 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1428/2866] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:47:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 11:47:04.101207 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:04.117733 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1484-fb71-4a15-963e-84d72f87fb8c service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:04.123911 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:04.126184 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:04.126841 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:04.127206 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] PATH_INFO: `/v3/projects` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:04.128359 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:04.132437 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:04.276966 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1439/2867] 10.222.0.20 () {60 vars in 1152 bytes} [Mon Jan 10 11:47:04 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 11:47:04.281616 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:04.293210 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1ecbd-9ff0-4de5-89ca-9d5707669bdd None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:04.360448 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:04.361332 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:04.361656 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:04.361979 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] PATH_INFO: `/v3/users` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:04.362981 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:04.366452 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:04.525201 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1429/2868] 10.222.0.20 () {60 vars in 1143 bytes} [Mon Jan 10 11:47:04 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 11:47:04.529227 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:04.540363 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d062141-5b54-43d6-ad64-e841c4615124 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:04.545879 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:04.547042 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:04.547452 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:04.547823 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:04.548716 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:04.550600 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:04.563685 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1440/2869] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 11:47:04.568949 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:04.580185 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5198f5-c916-4272-a360-9966c6c3193a admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:04.586739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:04.587829 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:04.588254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:04.588720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] PATH_INFO: `/v3/projects/b92b063ab43f4e6fb29792a7265cd2f3/users/c5cd54c1b0924536a3df945486311fd7/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:04.612899 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92b063ab43f4e6fb29792a7265cd2f3, user_id=c5cd54c1b0924536a3df945486311fd7, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:04.618824 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:04.748701 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1430/2870] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:47:04 2022] PUT /identity/v3/projects/b92b063ab43f4e6fb29792a7265cd2f3/users/c5cd54c1b0924536a3df945486311fd7/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:47:04.754744 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:04.770030 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cca98b-81f8-437a-bca5-6d985e573bd8 admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:04.866633 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e9e67-87ed-4c4d-b3a8-4c8b9c75089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:04.867766 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e9e67-87ed-4c4d-b3a8-4c8b9c75089f admin admin] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:04.868259 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e9e67-87ed-4c4d-b3a8-4c8b9c75089f admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:04.868627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e9e67-87ed-4c4d-b3a8-4c8b9c75089f admin admin] PATH_INFO: `/v3/roles` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:04.869506 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e9e67-87ed-4c4d-b3a8-4c8b9c75089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:04.871312 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e9e67-87ed-4c4d-b3a8-4c8b9c75089f admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:04.888149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1441/2871] 10.222.0.20 () {58 vars in 1121 bytes} [Mon Jan 10 11:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 11:47:04.892971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:04.912523 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3dff-e8b9-4e28-997e-c6f90d4cc470 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:04.916610 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:04.918083 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:04.918754 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:04.919235 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] PATH_INFO: `/v3/projects/b92b063ab43f4e6fb29792a7265cd2f3/users/c5cd54c1b0924536a3df945486311fd7/roles/cb161f7cc15b46b884b56cf0c9cf0367` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:04.922939 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92b063ab43f4e6fb29792a7265cd2f3, user_id=c5cd54c1b0924536a3df945486311fd7, role_id=cb161f7cc15b46b884b56cf0c9cf0367)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:04.928709 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:04.951030 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1431/2872] 10.222.0.20 () {60 vars in 1482 bytes} [Mon Jan 10 11:47:04 2022] PUT /identity/v3/projects/b92b063ab43f4e6fb29792a7265cd2f3/users/c5cd54c1b0924536a3df945486311fd7/roles/cb161f7cc15b46b884b56cf0c9cf0367 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:47:12.943954 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38270e-426a-4893-9168-0e1630fdef8e None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:12.944878 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38270e-426a-4893-9168-0e1630fdef8e None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:12.945372 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38270e-426a-4893-9168-0e1630fdef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:12.977102 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-0c38270e-426a-4893-9168-0e1630fdef8e None None] MFA Rules not processed for user `c5cd54c1b0924536a3df945486311fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:47:12.978427 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-0c38270e-426a-4893-9168-0e1630fdef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:13.063250 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1442/2873] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:47:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:47:13.083493 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:13.085636 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:13.209378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905289c2-c3ac-4ca1-9be5-a648a079c7ac admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:13.209378 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:13.210257 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:13.210769 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:13.211240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:13.297874 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:13.299638 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:13.309954 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1432/2874] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:47:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:47:23.297755 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:23.298397 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:23.298503 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:23.325351 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] MFA Rules not processed for user `170dcc817fa34bc781ffe7fedf729b88`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:47:23.327528 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:23.395677 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1443/2875] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:47:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:47:31.078663 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:31.080520 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:31.172048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2390bd2-4534-41d2-8c78-6e3e201fdebc service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:31.178524 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:31.179631 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:31.179882 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:31.180166 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:31.182951 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:31.210172 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:31.215945 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ef7b0-f523-4d45-b5ee-f7174ee614d7 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:31.230158 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1433/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:47:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:47:36.023137 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:47:36.037481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef6ad-aea2-4cf6-b95b-bbcf5391e481 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:47:36.042293 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:47:36.043149 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:36.043431 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:36.043708 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:36.046887 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:36.064991 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:47:36.066553 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:47:36.082366 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1444/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:47:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:47:37.655506 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:47:37.656091 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:47:37.656307 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:47:37.676361 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] MFA Rules not processed for user `fa0eed1277c2418ca9f815589ab58896`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:47:37.678736 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:47:37.687512 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1434/2878] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:47:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:48:00.924037 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:48:00.935378 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210577b-a93c-4d1b-9c9d-af254fbe68c2 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:48:00.939068 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:48:00.939781 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:48:00.939979 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:48:00.940247 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:48:00.951020 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:48:00.952612 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:48:00.963240 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1445/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:48:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:48:31.755310 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:48:31.757583 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:48:31.864590 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961e42-4bbd-4d94-8ea1-1ea493d1a957 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:48:31.870254 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:48:31.871400 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:48:31.871873 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:48:31.872349 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] PATH_INFO: `/v3/users/170dcc817fa34bc781ffe7fedf729b88` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:48:31.873843 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] RBAC: Authorizing `identity:delete_user(user_id=170dcc817fa34bc781ffe7fedf729b88)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:48:31.876012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:48:32.111233 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170dcc817fa34bc781ffe7fedf729b88'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.124267 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170dcc817fa34bc781ffe7fedf729b88'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.124971 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170dcc817fa34bc781ffe7fedf729b88'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.132796 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170dcc817fa34bc781ffe7fedf729b88'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.235223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170dcc817fa34bc781ffe7fedf729b88'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.242070 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1435/2880] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:48:31 2022] DELETE /identity/v3/users/170dcc817fa34bc781ffe7fedf729b88 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:48:32.495870 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:48:32.509248 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d3a1-e4f7-4892-be58-9b783e237457 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:48:32.568490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:48:32.569237 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:48:32.569516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:48:32.569788 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] PATH_INFO: `/v3/projects/77459867f2ca40c6aac9eebdcfed7ca2` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:48:32.571045 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77459867f2ca40c6aac9eebdcfed7ca2)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:48:32.573001 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:48:32.693358 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77459867f2ca40c6aac9eebdcfed7ca2', 'request_id': 'req-8cf13c80-fc55-4e4e-a95d-e4edb847808d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.783658 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77459867f2ca40c6aac9eebdcfed7ca2', 'request_id': 'req-8cf13c80-fc55-4e4e-a95d-e4edb847808d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.791565 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77459867f2ca40c6aac9eebdcfed7ca2', 'request_id': 'req-8cf13c80-fc55-4e4e-a95d-e4edb847808d'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.802204 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] The token cache is being invalidate because project 77459867f2ca40c6aac9eebdcfed7ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:48:32.802516 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.803179 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:48:32.804701 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1446/2881] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:48:32 2022] DELETE /identity/v3/projects/77459867f2ca40c6aac9eebdcfed7ca2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:48:39.163830 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:48:39.165367 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:48:39.228528 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08642b1-ca70-4577-be2b-36739b96350f admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:48:39.276739 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:48:39.277371 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:48:39.277646 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:48:39.277915 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:48:39.279715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:48:39.289601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:48:39.291107 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33640437-a999-4155-a9dd-4a85dd9965e5 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:48:39.299011 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1436/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:48:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:50:01.866669 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:50:01.868846 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:02.028309 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf13c80-fc55-4e4e-a95d-e4edb847808d admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:50:02.034409 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:50:02.035072 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:50:02.035361 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:50:02.035631 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:50:02.037638 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:02.053576 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:50:02.056226 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:50:02.069985 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1447/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:50:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:50:03.970116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] REQUEST_METHOD: `POST` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:50:03.970720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:50:03.970720 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:50:03.987996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.auth.core [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] MFA Rules not processed for user `fa0eed1277c2418ca9f815589ab58896`. Rule list: `[]` (Enabled: `True`). {{(pid=79425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:50:03.989265 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:04.046758 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1437/2884] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:50:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:50:05.320286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:50:05.320286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:05.397196 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecced5-e6d3-487d-932a-326fb3f9e8fa service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:50:05.404439 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:50:05.405091 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:50:05.405374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:50:05.405652 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:50:05.407490 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:05.420481 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:50:05.422082 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:50:05.433533 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1448/2885] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:50:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:50:21.856601 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:50:21.879129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a50adb-5668-48a3-8beb-1c05d86ee2f4 None None] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:50:21.886053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:50:21.886053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:50:21.886053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:50:21.886053 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:50:21.888902 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:21.903163 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:50:21.904996 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:50:21.919542 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1438/2886] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:50:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:50:26.883888 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:50:26.916758 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e88-779a-4507-acdc-8f2a4fe59d14 service placement] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:50:26.922424 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:50:26.923115 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:50:26.923390 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:50:26.923729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:50:26.925449 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:26.955510 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:50:26.957143 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2c869-c39e-4806-bdc3-9bb2f3b8001c service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:50:26.968398 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1449/2887] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:50:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:50:38.762161 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:50:38.789832 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90466bc-51fd-47ab-bbe0-1dfe0e8f363b service nova] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:50:38.797230 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:50:38.797907 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:50:38.798188 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:50:38.798495 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:50:38.800315 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:50:38.966457 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:50:38.968096 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:50:38.979062 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1439/2888] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:50:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:52:02.234899 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] REQUEST_METHOD: `POST` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:52:02.235515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:52:02.235515 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:52:02.254847 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.auth.core [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] MFA Rules not processed for user `fa0eed1277c2418ca9f815589ab58896`. Rule list: `[]` (Enabled: `True`). {{(pid=79426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 11:52:02.256073 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:52:02.263900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1450/2889] 10.222.0.20 () {58 vars in 957 bytes} [Mon Jan 10 11:52:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 11:52:02.597529 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:52:02.599048 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:52:02.632793 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e86558-568a-4571-9ee7-f4e1d29dc20d service placement] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:52:02.636505 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:52:02.637139 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:52:02.637483 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:52:02.638319 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:52:02.640084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:52:02.651745 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:52:02.653153 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:52:02.661715 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1440/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:52:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:52:14.048151 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:52:14.061875 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f80414-5796-427a-83ee-4e22a783c825 None None] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:52:14.068420 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df05886e51f34628a524477b98227f40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:52:14.069263 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:52:14.069676 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:52:14.070095 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:52:14.072322 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:52:14.086286 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:52:14.088384 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:52:14.098729 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1451/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:52:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:53:41.503090 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:53:41.504621 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:53:41.518676 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1da46-5af7-4c6a-99ec-e069008f9df8 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:53:41.523074 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:53:41.524414 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:53:41.524699 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:53:41.524976 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:53:41.536665 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:53:41.538766 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:53:41.548369 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1441/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:53:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 11:53:53.845730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:53:53.858932 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8b309-4dd8-4a91-81be-cb13ab3932e4 service nova] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:53:53.873241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:53:53.873241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:53:53.873241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:53:53.873241 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:53:53.873709 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:53:53.885926 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:53:53.887538 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:53:53.901681 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1452/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:53:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:53:55.110012 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:53:55.119213 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7b54-58e3-4cf5-952c-71229bd84ba7 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:53:55.129223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:53:55.129223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:53:55.129223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:53:55.129223 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:53:55.132862 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:53:55.145076 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:53:55.147089 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:53:55.157797 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1442/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:53:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:54:09.249389 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:54:09.259529 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35f25d-b02a-447d-a3ba-6c752e2cc17e service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:54:09.263535 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd7492ffb2a543979f94421c2649e5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:54:09.264173 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] REQUEST_METHOD: `GET` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:54:09.264453 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:54:09.264730 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:54:09.266639 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:54:09.385479 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:54:09.387552 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:54:09.417513 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1453/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 11:54:17.654821 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:54:17.656950 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:54:17.681860 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e00ba-14fe-4b83-aaa6-b6ccb36d7503 service neutron] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:54:17.689980 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:54:17.691561 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:54:17.692084 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:54:17.693154 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] PATH_INFO: `/v3/users/fa0eed1277c2418ca9f815589ab58896` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:54:17.695609 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0eed1277c2418ca9f815589ab58896)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:54:17.699893 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:54:17.955181 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0eed1277c2418ca9f815589ab58896'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:17.967407 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0eed1277c2418ca9f815589ab58896'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:17.968159 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0eed1277c2418ca9f815589ab58896'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:17.976122 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0eed1277c2418ca9f815589ab58896'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.067712 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0eed1277c2418ca9f815589ab58896'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.074795 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1443/2896] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:54:17 2022] DELETE /identity/v3/users/fa0eed1277c2418ca9f815589ab58896 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 11:54:18.377303 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:54:18.387039 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fdc11-1077-4925-a414-51276b1b3f47 service neutron] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:54:18.447768 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:54:18.448623 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:54:18.448900 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:54:18.449176 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] PATH_INFO: `/v3/projects/3f1d77884a2a4a7ebb85ba71e9d864a7` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:54:18.450659 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1d77884a2a4a7ebb85ba71e9d864a7)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:54:18.452537 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:54:18.607845 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'request_id': 'req-4554f425-292f-4146-ad59-b51cfce783ff'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.707917 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'request_id': 'req-4554f425-292f-4146-ad59-b51cfce783ff'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.715591 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'request_id': 'req-4554f425-292f-4146-ad59-b51cfce783ff'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.726444 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] The token cache is being invalidate because project 3f1d77884a2a4a7ebb85ba71e9d864a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:54:18.726725 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.727387 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:18.728937 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1454/2897] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:54:18 2022] DELETE /identity/v3/projects/3f1d77884a2a4a7ebb85ba71e9d864a7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:54:18.733092 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:54:18.734921 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:54:18.749129 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62ec98-c6d3-49d9-ae3e-1bd1b4d5b12d admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:54:18.805073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:54:18.807642 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:54:18.808006 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:54:18.808572 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] PATH_INFO: `/v3/users/c5cd54c1b0924536a3df945486311fd7` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:54:18.809995 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cd54c1b0924536a3df945486311fd7)` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:54:18.812073 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:54:19.019140 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cd54c1b0924536a3df945486311fd7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.031240 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cd54c1b0924536a3df945486311fd7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.032116 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cd54c1b0924536a3df945486311fd7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.039628 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cd54c1b0924536a3df945486311fd7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.126780 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.notifications [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cd54c1b0924536a3df945486311fd7'} {{(pid=79425) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.135157 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1444/2898] 10.222.0.20 () {58 vars in 1223 bytes} [Mon Jan 10 11:54:18 2022] DELETE /identity/v3/users/c5cd54c1b0924536a3df945486311fd7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:54:19.440872 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Authenticating user token {{(pid=79426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:54:19.451235 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.fernet_utils [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:54:19.456374 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554f425-292f-4146-ad59-b51cfce783ff admin admin] Validating token access rules against request {{(pid=79426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:54:19.530627 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bed62ab9bae84e5e97211f8e6376a1d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd70255155e6410bb2d9f4554d34cff0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:54:19.531497 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:54:19.531778 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:54:19.532054 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] PATH_INFO: `/v3/projects/b92b063ab43f4e6fb29792a7265cd2f3` {{(pid=79426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:54:19.533393 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92b063ab43f4e6fb29792a7265cd2f3)` {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:54:19.535454 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] RBAC: Authorization granted {{(pid=79426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:54:19.702440 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92b063ab43f4e6fb29792a7265cd2f3', 'request_id': 'req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.827721 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92b063ab43f4e6fb29792a7265cd2f3', 'request_id': 'req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.835288 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92b063ab43f4e6fb29792a7265cd2f3', 'request_id': 'req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4'} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.846026 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] The token cache is being invalidate because project b92b063ab43f4e6fb29792a7265cd2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 11:54:19.846341 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.847029 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: DEBUG keystone.notifications [None req-b7b943b1-fbf3-4f70-a84c-ca36749c3be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 11:54:19.848624 dv-cinder-master-3-iscsi devstack@keystone.service[79426]: [pid: 79426|app: 0|req: 1455/2899] 10.222.0.20 () {58 vars in 1232 bytes} [Mon Jan 10 11:54:19 2022] DELETE /identity/v3/projects/b92b063ab43f4e6fb29792a7265cd2f3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 11:55:43.776466 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Authenticating user token {{(pid=79425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 11:55:43.779906 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:55:43.857453 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00019-d17c-4be9-98e6-01715590a615 admin admin] Validating token access rules against request {{(pid=79425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 11:55:43.937109 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b67735ed66544af696d9274554f3001d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c5459e4b2b6463e9e155429f1541f97', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 11:55:43.938078 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] REQUEST_METHOD: `GET` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 11:55:43.938411 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] SCRIPT_NAME: `/identity` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 11:55:43.938686 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 11:55:43.941250 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.fernet_utils [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 11:55:43.954022 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 11:55:43.955904 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c94bf-7907-43ac-893c-4fb2bd4ec8cb service placement] RBAC: Authorization granted {{(pid=79425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 11:55:43.967143 dv-cinder-master-3-iscsi devstack@keystone.service[79425]: [pid: 79425|app: 0|req: 1445/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Jan 10 11:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)